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ABSTRACT 


Models are developed for two different Combat Logistics situations, one in the area 
of Operational Combat Logistics and the other in Combat Support Logistics. In the 
first situation, Operational Combat Logistics models are developed to assist in schedul- 
ing the replenishment of weapons within a Navy Battle Group following a combat en- 
gagement. Consideration is given to the uncertain arrival of a follow-on attack which 
may interrupt the replenishment process before all requirements are satisfied. In a 
justifiably simplified approach, optimal Vertical Replenishment scheduling is achieved 
by sequencing lifts in decreasing order of an index, called Logistics Weighted Combat 
Value (LWCV). The LWCV method is then used in an efficient scheduling heuristic for 
a realistic model and produces results which compare very favorably with a locally op- 
timum schedule obtained with a lengthy local neighborhood search. Separately, for a 
simple model, optimal Connected Replenishment scheduling is achieved with dynamic 
programming (DP). The DP approach is then adapted to more realistic situations. 
Examples of the implementations of these methods are presented. In the second situ- 
ation, Combat Support Logistics models are developed to analyze the combat availabil- 
itv of a system supported by a single diagnosis repair test facility. A characteristic that 
distinguishes Combat Support Logistics from peacetime in-service support, 1s that in 
peacetime, a logistics system mav operate in steady-state, whereas, because of the dv- 
namic intensity of combat, steady-state conditions mav never be reached in periods of 
conflict. The modeling technique is to use a diffusion approximation valid for the heavy 
traffic conditions anticipated under combat conditions. The simple analytic solutions 
obtained are compared to simulation results and found to be verv satisfactory. Allter- 
native scheduling policies that reflect different organizational maintenance service disci- 
plines can be readily compared. The model provides a framework for choosing 


near-optimal spare module allocations within budget constraints. 
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I. COMBAT LOGISTICS OVERVIEW 


A sound logistic plan is the foundation upon which a war operation should be based. 
If the necessary minimum of logistics support can not be given to the combatant 
forces involved, the operation may fail, or at least be only partially successful. 


-- R. A. Spruance 


A. NAVY LOGISTICS BACKGROUND 

It is beyond the scope of this work to provide a comprehensive survey of logistics 
in the Navy. However, some concepts are briefly described here to establish a frame of 
Rererence. 

As defined by the Chief of Naval Operations [Ref. 1], the Navy Logistics Svstem 
comprises three primary, interacting functions: acquisition logistics, in-service support, 


and operational logistics. 


1. Operational Logistics in Combat 

Operational logistics concerns the allocation of logistics support resources ar all 
levels within the Operating Forces to enable the successful execution of assigned 
missions. One of the levels specified is Battle Force’Unit Logistics, which includes the 
planning, management and execution of logistics activities within the Battle Force or 
Uanit. 

The ships whose primary mission it 1s to conduct Battle Force, Unit logistics 
activities are the supplv, ammunition, and fuel replenishment ships which are collectively 
referred to as Combat Logistics Force ships. The term Combat Logistics Force \s fairly 
new. The previous terminology was Mobile Logistics Support Force and before that 
Service Force. Although the term combat logistics is used in this context, it 1s not ex- 
plicitly defined in the Navy literature. The current terminology 1s generally taken as a 
reflection of the operational potential of the CLF ships to deploy as a part of a Battle 
Group, or otherwise directly support a Battle Group, whether or not that Battle Group 
actually engages combat, or otherwise faces imminent attack. In this current work, the 


term combat logistics is used more specifically to reflect a direct association with actual 


combat. The following definition is adopted to describe operational combat logistics as 


a specialization of operational logistics: 


Definition 1.1: Operational Combat Logistics comprises logistics activities 
Which are conducted within combatant forces, during an ongoing or imminent 


combat, and which directly affect the outcome of the combat. 


A specific logistics function that clearly belongs in the area of operational 
combat logistics is that of resupplying ammunition to combatant ships during the in- 
terval between successive raids of attacking aircraft. This type of combat logistics 1s the 
focus of the next three chapters. Chapter II provides an introduction to the problem 
of replenishing Battle Group ammunition during combat. and the models of Chapters 


II] and IV deal with aspects of this problem. 


2. In-service Support of Combat Operations 

In-service support concerns the distribution of necessary supplies and proper 
maintenance of weapon and support systems to ensure that peacetime and wartime 
Navy readiness and sustainability goals are met. One of the principal in-service support 
functions performed bv elements of the Navy shore establishment and operating forces 
is called simply Navy Maintenance. 

The actual maintenance of Navy ships, aircraft, submarines, Weapons and 
equipment is performed on a highly decentralized basis within the various Navy coni- 
munities bv fleet units, contractors. depots and shipvards. Whereas all levels of main- 
tenance support are concerned, ultimately, with returning the serviced unit to a 
condition in which it can carry out its mission, including combat, organizational level 
maintenance bv the repair personnel of a deploved unit can be the most closely related 
to sustaining combat operations. The following definition 1s adopted to describe combat 


support logistics as a specialization of in-service support: 


Definition 1.2: Combat support logistics comprises the supply and distrib- 
ution of vital weapon systems components, and corrective maintenance of weapon 
systems within combatant forces, during an ongoing or imminent combat, and 


Which directly affect the sustainabilitv of combat operations. 


to 


A characteristic that distinguishes combat support logistics from peacetime in-service 
support, is that in peacetime, a logistics system may operate in steady-state, whereas due 
to the dynamic intensity of combat, steady-state conditions may never be reached in 
periods of conflict. The models of Chapter V relate to a problem in combat support 


logistics -- the transient analysis of the effect of alternative repair, service policies on 
combat system availability. 


Il, INTRODUCTION TO THE PROBLEM OF REPLENISHING 
AMMUNITION DURING COMBAT 


A. THE COMBAT REPLENISHMENT PROBLEM 

The scenario in which the problem being studied may arise is set in a conventional 
hot war. A Carrier Battle Group 1s operating in an area where it 1s subject to attack by 
enemy aircraft with anti-ship missiles. It is anticipated that air raids will occur in large 
waves. The time between waves is available for replenishing anti-aircraft ammunition 
within the Battle Group in anticipation of the next raid. Replenishment ammunition 1s 
stocked by an on-station ammunition ship that can provide limited parallel service. 
However, the time between waves is uncertain and likely to be insufficient to satisfy all 
requirements. Besides limited time available, the quantity of ammunition available from 
the Battle Group on-station replenishment ship mav be less than the total requirements. 
The problem facing the decision maker may be simply stated: how besr to replenish 


ammunition in the uncertain time available between raids? 


B. OPERATIONAL LOGISTICS BACKGROUND 


1. Afloat Logistics 
Replenishment at sea 1s conducted from combat logistics force ships designed 
for that purpose. Ships that provide mainlv a single commodity include the ships desig- 
nated as AE, AO, and AFS, which carry ammunition, fuel, or stores respectively. 
Multi-product replenishment ships include the AOE and AOR which carry a mix of fuel 
and ammunition. 
Hereford and Spiegel [Ref. 2] gave the following unclassified description of what 


they refer to as the LU. S. Navy's afloat logistics system. 


In order to maximize the utility of units, the L. S. Navy has developed a 
system to resupply carrier battle forces while they are at sea. ( Figure | ) shows a 
schematic representation of the Navv’s primarv means of providing afloat logistics 
Support in Wartime. Supplies (POL, ordnance, stores, spare parts, etc.) are brought 
by strategic lift assets to advanced support bases. Here they are transferred to 
console ships. The console ships are single product ships (oilers, ammunition ships, 
stores ships) that then bring the supplies to the operations areas of the battle force. 


Once at the battle force, the supplies are transferred to a multiproduct station ship 
(AOE) that then is charged with redistributing the supplies to the other ships in the 
battle force. Constituents of the battle force can also be serviced by single product 
shuttle ships. The ideal station ships (such as the present AOEs) have sufficient 
speed to maintain position with the battle force at all times. 


Strategic forward shuttle Battle 
CONUS |——————__> SSnEnEEEEEEEen 


sealift port ships Group 


Figure I. Model of Underway Replenishment Process 


The problem of replenishment at sea during combat is complicated bv the pos- 
sibility that while in formation for combat, anti-air warfare ships may be dispersed at 
great distances from the formation center where the carrier and logistics ship are likely 
to be. To illustrate the expanse of a modern Carrier Battle Group dispersed formation, 
then Chief of Naval Operations, Admiral Watkins [Ref. 3] overlaid a Battle Group on a 
map of the east coast of the United States to show that with the center of the formation 
located in Washington, DC, anti-air warfare ships might be stationed in Philadelphia, 
Pa., Harrisburg, Pa, Clarksburg. W.Va., Norfolk, Va., Trenton, N.J., and Dover, Del. 


2. Underway Replenishment of Ammunition 

There are two basic methods for a station ship to physically transfer ammuni- 
tion at sea to a combatant ship, which are described in the doctrinal naval warfare 
publication NWP 14 [Ref. 4]. One method 1s called connected replenishment, or 
CONREP for short, and the other method which uses helicopters 1s called vertical re- 
plenishment, or VERTREP for short. In both methods the AE, AOE, or AOR that pro- 
vides the ammunition is referred to as the delivery ship, and the combatant unit that 1s 
to be serviced (replenished) 1s referred to as the receiving ship. 

For CONREP, the delivery ship maintains a steady course at moderate speed, 
and the receiving ship maneuvers into a position parallel to the delivery ship and sepa- 
rated by about 30 meters. While alongside, one or more wire highlines are rigged be- 
tween the two ships, and pallets or containers of ammunition are winched from the 


delivery ship to the receiving ship. 


For VERTREP, a logistics helicopter is used to lift the pallets or containers of 
ammunition from a pickup area on the delivery ship to a drop area on the receiving ship. 
VERTREP may be conducted concurrently with CONREP while the receiving ship 1s 
alongside, or at greater distance. Typically, the distance is kept close to maintain a high 
transfer rate, but VERTREP could be conducted at greater ranges limited primarily by 
command and control considerations. 

Prior to transfer by either CONREP or VERTREP, the delivery ship must re- 
move ammunition from storage magazines and stage it at the delivery station. These 
delivery ship replenishment activities will be collectively referred to as breakout. After 
transfer by either CONREP or VERTREP, the receiving ship must move the ammuni- 
tion from the receiving station and load it into the appropriate magazine. These re- 
ceiving ship replenishment activities will be collectively referred to as strikedown. Also, 
depending on the particular type of weapon, breakout and strikedown activities may in- 
clude changing ordnance from a storage configuration to a transfer configuration, and 
then changing it from a transfer configuration to ready-for-use configuration, respec- 
tivel 

Stiles [Ref. 5] provided an unclassified discussion of how significant stnkedown 
time can be in the case of reloading the most modern missile launcher, the Mk-41 Ver- 
tical Launching System (VLS). which is installed in the most capable anti-air warfare 
ships.in. the U.S. Nav. the AEG I Saemitsers 


The greatest limiting factor in terms of both speed and flexibility of VLS UnRep 1s 
the strikedown crane and the assorted deck-handling equipment used in conjunction 
with it. UnRep ships are currently capable of passing over many more missiles than 
the VLS crane is capable of striking down. 
Anderberg, Feldman and Odell [Ref. 6] raised the following questions, which 
remain unanswered, concerning ordnance replenishment in their analysis of operational 


logistics in a major fleet exercise: 


e How do the (decision makers) decide on the precedence of one ordnance replen- 
ishment over another? 


e Given the anticipated length of time required for fully rearming a guided-missile 
destrover or cruiser, how does time alongside get rationed among ships needing 
replenishment so that all of the trme is not consumed bv one ship? 


The models in the following chapters are aimed at answering these questions. 
Chapter III considers scheduling of VERTREP, and Chapter IV models the CONREP 


problem. 


C. MODEL FORMULATION PRELIMINARIES 


]. Measures of Effectiveness and Objectives 
The concept of combat logistics manifests itself in identifying objectives and ap- 
propriate measures of effectiveness for the problem. If combat outcome were not con- 
sidered, then objectives could be stated in pure logistics terms. Examples of pure 
logistics objectives are given in Figure 2. 


Maximize the ( ) number of of weapons transferred. 
expected rounds 
minimum tons 
lifts 


Minimize the ( ) tume to transfer of the weapons requested. 
exmected 
minimum some number 
ma\imum some percentage 
variance of 


Maxinuze the probability that a particular level of re-arming is 
completed by a deadline. 


Mininuze the time ships are away from assigned stations for replenishment. 





Figure 2. Examples of Pure Logistics Objectives 


If logistics activities were not considered, then objectives could be stated in pure 


combat terms. Examples of pure combat objectives are given in Figure 3. 


Maximize the ( ) number of enemy 
expected platforms engaged 
nunimum ASMs_ destroyed 


Maximize the ( ) number of own surviving. 
expected 
minimum tonnage 
aircraft 


people 


Maximize the ( ) number of successive waves survived. 
expected 
minimum 


Minimize the ( ) number of enemy that penetrate defenses. 
expected platforms 
maximun) ASM 


Minimize the ( 
expected 
maximum tonnage 
aircraft 
people 


Maximize the probability of survival of some number of own forces. 


Maximize the probability of kill of some number of enemy forces. 





Figure 3. Examples of Pure Combat Objectives 


There would be several deficiencies in the results of the modeling 1f combat and 
logistics Were considered separately. At one extreme, if time to conduct transfers (a pure 
logistics consideration) were not considered, and the only criterion was which weapons 
are most important regardless of the time it takes to transfer them, then a clearly unde- 
sirable result could be that the entire time available could be consumed (slowly) trans- 
ferring a few Vertical Launch missiles. At the other extreme, if time to conduct transfers 
were the only consideration, disregarding the combat value of weapons, then another 
undesirable result could be that the entire time available could naively be allotted to onlv 
making VERTREP transfers to receivers who were at minimum range So as to maximize 
transfer rates, without considering that by taking a little more time, much more combat 


value may accrue. 


Combat Logistics objectives can be thought of as: a fusion of pure logistics ob- 
jectives and pure combat objectives. Thev could be thought of as combat objectives 
expressed as functions of a logistics process, or logistics objectives “weighted” by the 


value of the material in combat. Examples of combat logistics objectives are given in 
Figure 4. 


Maximize the expected additional enemy kills due to weapons transferred. 


Minimize the maximum time required to transfer those weapons that provide 
Some specified probability of mission success. 


Maximize the expected total combat value of weapons transferred. 





Figure 4. Examples of Combat Logistics Objectives 


In this work, models are developed that seek to maximize the expected combat 
value of Weapons transfer completions prior to the next raid arrival. A verv simple 
combat model is used in Chapter III to quantufy the idea of combat value in a parucular 
comt:: scenario. That simple combat model is subsequently examined to provide in- 
sight into the characteristics that should be captured in a more general combat value 


function. and a heuristic method to derive combat values is proposed in an appendix. 


2. Units of Measurement for Weapons 

It is convenient to specify what units should be used to count numbers of 
weapons. As with the choice of measures of effectiveness, there are several possibilities 
in the context of a combat logistics problem. 

At one extreme, in some pure combat models an appropriate unit of measure- 
ment for weapons might be a round of ammunition, such as a missile. However, if it is 
desired to consider different weapons, the modeling would encounter order of magnitude 
differences if comparing, say, one surface-to-air missile round, with one round of anti- 
aircraft gun ammunition. Besides confounding combat effectiveness comparisons, these 
scale differences would be especially pronounced in logistics, where individual rounds of 


ammunition mav vary greatly in weight and volume. 


At the other extreme, in some pure logistics models an appropriate unit of 
measurement for weapons might be a ron of ammunition. This has the advantage of 
overcoming some of the problems of scale, and may be particularly appropriate and 
useful in a model concerning sealift or airlift. It is, however, not an operational unit of 
measurement, readily used by the combatant ships who receive the weapons. 

Between these two extremes, there is the operational logistics problem of Battle 
Group replenishment. Here, it is suggested that the narural unit of measurement for 
weapons is a lift of ammunition. On the logistics side, a lift is the unit that 1s actually 
handled by rig crews, helos, dollies, forklifts, etc. And with respect to combat, a lift ag- 
gregates smaller ordnance items, like rounds of gun ammunition and chaff, so that the 
units are comparable with respect to combat effectiveness (1.e., 1t 1s not sensible to 
compare one round of 76mm gun ammunition with one Standard surface-to-air missile; 


it is more reasonable to compare one missile with one pallet of 76mm.) 


3. Weapons State 
Using common military terminology, the number of weapons available for 
combat 1s referred to as a weapons state. The weapons state of the entire battle group 
mav be thought of as a vector of the weapons states of the individual ships in the battle 
group. To consider more detail, an individual ship’s weapons state mav itself be a vector 


of the weapons state of each type of weapon carried. 


D. OPERATIONS RESEARCH BACKGROUND 


It appears that the most closely related operations research models for this problem 
are in the area of scheduling theory in general, and stochastic shop scheduling in partic- 


ular. A brief review of the pertinent terminology and literature follows. 


1. Scheduling Theory Terminology 
The terminology of scheduling theory comes from the manufacturing industry; 
see Conway, Maxwell, and Miller [{Ref. 7] or French {Ref. 8]. Most authors use the idea 
of scheduling some number of jobs to be processed through some number of machines. 
In the general job-shop problem, each job has its own processing order that mav be un- 
related to the processing order of other jobs. A special case of a job-shop which occurs 


when all the jobs have the same processing order is referred to as a flow-shop, because 


10 


the jobs flow between machines in the same order. The processing of a job on a machine 
is Called an operation, and the length of time it takes to perform an operation is called 
the processing time. Typically, the time required to ser up a machine to process a job is 
included in the processing time. The epoch at which an operation ends is called the 
completion time. If an operation is required to be completed by a particular time, that 
time is called a due date. Some common measures of effectiveness in scheduling theory 
relate completion times and due dates. Lareness of a job is the difference between its 
completion time and due date. A positive difference is called tardiness, and a negative 
difference is called earliness. The number of late jobs, or number of tardy jobs counts the 
number of jobs where completion time exceeds the due date. The contribution of each 
job to any of these measures of effectiveness may be weighted by the relative importance 
of the job. The time at which a job becomes available for processing is called its release 
date. If the number of jobs and their release dates are known and fixed, the problem is 
said to have a static arrival process. In contrast, if the jobs arrive randomly, the problem 
is said to have a dynamic arrival process. 

In the Battle Group Ammunition Replenishment problem, the lifts are jobs; the 
breakout on the delivery ship, transfer via CONREP station or VERTREP helicopter, 
and strikedown on the receiving ship are operations on machines; and the jobs must 
follow the path of breakout machine to transfer machine to strikedown machine which 
defines a flow-shop. The breakout, transfer, and strikedown times are processing times. 
All lift requirements are known at the outset which defines a static arrival process for 
jobs; and the time at which each receiver can receive his first lift is a release date. The 
time by which strikedown of the lifts must be completed so that the ordnance is available 


for combat is a due date. 


2. Stochastic Considerations 

Stochastic considerations enter shop scheduling problems in the literature in 
several ways. The most common is in the form of stochastic processing times. Another 
form is stochastic release dates or due dates; see Pinedo and Schrage [Ref. 9], Pinedo 
[Ref. 10], Coffman [Ref. 11 ], and Dempster, Lenstra, and Rinnooy Kan [Ref. 12 ]. 

The dominant stochastic element in the Battle Group Ammunition Replenish- 
ment problem is the time of arrival of the next wave of attack which may be thought 
of as a stochastic due date. Coping with the uncertainty of a raid’s arrival time, and 


immediate replenishment termination js clearly of utmost importance in this setting. 


In addition to the stochastic due date, there is some inherent variability in the 
release dates and processing times. In the case of release dates, however, the time at 
which each receiver can receive his first lift is mostly determined by the relative positions 
of the delivery ship and the receiving ship, and the relative speeds at which they ma- 
neuver, or relative speed at which a VERTREP helicopter flies between them. Since 
those positions and speeds (which may depend on the current wind and weather condi- 
tions) are generally known at the outset of a replenishment period, release dates wull be 
treated as deterministic. Similarly, in the case of processing times, the attributes of each 
job are known. Each job is a particular lift of ordnance, the operations to process each 
lift are known, and times to perform those operations under normal circumstances are 
known, at least approximately. To obtain an initial schedule, processing times under 
normal circumstances will be treated as deterministic. 

Another area in which uncertainty enters the problem concerns random equip- 
ment breakdowns. If a fixed schedule were to be developed and strictly adhered to, 
random breakdowns could seriously impact the objectives of the replenishment. How- 
ever, the replenishment process 1s continually observed, and it is Known when a break- 
down occurs. When that happens, if an estimated time of repair (possibly infinite) can 
be given, then the initial schedule can be revised. The issue of random equipment 


breakdowns will be handled by dynanuc schedule revision. 


The objective of the Battle Group Ammunition Replenishment problem, which 
was described above as maximizing the expected combat value of weapons transfer 
completions prior to the next raid arrival, may be expressed in scheduling theory termi- 
nology and 1s equivalent to minimizing the weighted expected number of late jobs in a flow 


shop with a stochastic due date. The weights in this case are the combat values. 


3. Dynamic and Stochastic Scheduling 

For stochastic scheduling problems with a dynamic arrival process, the pre- 
dominant theoretical approach is that of queueing theory; see Conway, Maxwell, and 
Miller [Ref. 7] for a treatment of the interrelation between queueing theory and 
stochastic scheduling. In the replenishment problem, however, the arrival process is 
Static, so that other approaches arise. 

A theoretical approach to stochastic scheduling that is quite distinct from 
queueing theory has been developed by Gittens and others; see Gittens and Nash [Ref. 


13] and Gittens [Ref. 14]. This method assigns a dynamic allocation index (also referred 


to as a Gittens index) to each job, and then schedules the jobs in decreasing order of this 
index. The Gittens index is updated as the jobs are processed (hence the word 
dynamic) which allows the schedule to adapt to the realization of arrivals and processing 
times. 

In Chapter III, a prototype model is developed for scheduling VERTREP under 
special conditions, which leads to scheduling lifts in decreasing order of a ratio, which 
in the context of the replenishment problem is called a logistics weighted combat value 
(LWCV). Although the development of the model does not invoke the Gittens approach 
-- it uses an interchange argument (see Ross [Ref. 15] ) -- the result corresponds to what 
Gittens [Ref. 16] calls forwards induction, and the LWCYV ratio is an example of a Gittens 
index. The simple VERTREP problem considered in the prototype model is thus an 
example of a problem for which the use of a Gittens Index will produce an optimal 
schedule. 

A more gencral methodology that may be applied to stochastic scheduling 
probleins uses backward induction, so as to take into consideration future rewards as well 
as immediate rewards. In the CONREP model of Chapter IV, the principal approach 
is dvnamic programming: see Bellman [Ref. 17], Denardo [Ref. 18], Minoux [Ref. 19 ]. 
Ross [Ref. 15]. or Whittle [Refs. 20, 21]. 


Ii. THE COMBAT VERTREP PROBLEM 


The vertical replenishment (VERTREP) problem is to determine the best sequence 
in Which to dispatch replenishment ammunition by helicopter from a delivery ship to 
several receiving ships. When an attack is anticipated, the problem 1s called the Combat 
VERTREP Problem, and the sequence of transfers should be best with respect to a 


Combat Logistics objective, as discussed in the previous chapter. 


A. A PROTOTYPE MODEL 

A prototype model is developed in which an optimal sequence of deliveries can be 
determined by criteria due to an interchange argument. This is an extension of a model 
given by Ross |Ref. 15]. The basic idea in the interchange argument }s that an arbitrary 
sequence of deliveries 1s considered, and then another sequence 1s determined by inter- 
changing anv two consecutive deliveries. The conditions under which this interchange 


leads to an improvement in the measure of effectiveness are then examined. 


1. A Simple VERTREP Problem 

This prototype model considers the problem of scheduling VERTREP deliveries 
with one delivery helicopter within a Battle Group which contains one delivery ship and 
several receiving ships. Each receiver requests several deliveries, or /ifts, of ammunition. 
The time available to conduct ammunition transfers, the air raid interarrival time, 1S a 
random variable, with known distribution. The times to conduct transfers to cach re- 
ceiver, Which include helicopter delivery times and receiver strikedown times are assumed 
to be known. When an arr raid arrives, it terminates the replenishment process; transfers 
in progress are not completed. In this model, let the value of having some specified 
number of weapons available when combat commences be quantified by a measure 
called combat value. Since the time when the replenishment process terminates (and 
combat commences) 1s uncertain, the measure of effectiveness to be maximized by choice 


of delivery sequence is expected combat value. Let T denote the air raid arrival time. 


2. The Replenishment Process 

This replenishinent process is now described under an arbitrarv ordering of de- 
liveries. Let L denote the total number of lifts to be sequenced, and the index / denote 
the sequence in which lifts are delivered; /e {1,..., 2}. Let the variable D, denote the 
known time it takes a helicopter to pick up the /* lift from the delivery ship, fly to the 
receiving ship, and drop off the lift; let R,, denote the known helicopter return time after 
dropping off the lift; and let S, denote the time it takes the receiver from when the lift is 
dropped off until strikedown is complete. The replenishment process, as depicted in 
Figure 5, starts with the delivery helicopter departing the delivery ship with the first lift 
at ime r=Q. It takes time D, to deliver the first lift. Then, at time r= D, , the receiver 
of the first lift immediately starts strikedown, and the helo returns for the second lift. 
It is assumed that strikedown queues do not develop on the receivers, and as a conse- 
quence, delivery or strikedown of subsequent lifts are not precluded or delaved by lifts 
previously delivered (i.e., there is no blocking), and strikedown completions are in the 
same order as deliveries. One way to model this is to assume that S,< R,, for all lifts.! 
The first transfer is conipleted at time r= D, + S, ; the helo returns from the first lift and 
picks up the second lift at time = D, +R, ; the second transfer 1s completed at time 
t= D,+ R, + S,; etc. 

Let the variable, V,, denote the total combat value of all weapons available after 
completion of the /* transfer; and V,, denote the combat value of Weapons initially 
available before replenishment. Then, define the marginal value of the /* lft as 
vy, = V,— V._, ; where the use of lower case represents marginal. or incremental, change 
in combat value. Assume the marginal values are non-negative. The accumulation of 


total combat value during the replenishment process is shown in Figure 6. 


3. Expected Combat Value 
An expression is now derived for the expected combat value under an arbitrary 
ordering of deliveries. Start by observing that the total combat value attained under any 
ordering equals I’, if an attack arrives and interrupts the replenishment process before 
completion of the first transfer. It equals V, if an attack arrives after completion of the 
first transfer and before completion of the second transfer. And, in general, the total 
combat value attained under any ordering equals V, if an attack arrives after completion 


of the /* transfer and before completion of the /+1* transfer, for /=1,...,L—1. 


1 Less restrictive conditions are discussed later. 


receiver 





Figure 5. Replenishment Process 


Finally, it equals }V’, if an attack does not arrive until after completion of the last trans- 
fer, 

To write an expression for this, let O, denote any arbitrary ordering, where the 
subscript will be used later to distinguish specific orderings. Let }(O,) denote the total 


combat value under ordering O,. which can then be expressed 
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Figure 6. Combat Value 


For compactness, let the variable I?’, denote the partial sum of deliverv and return times 


through the A ™ lift; that is 


k 


=) (Di+R) 


i=] 


If each V, is then expanded as a sum of the initial value and marginal increases, then 


(3.1) can be rewritten as 


On a, aT < Dasa 
= Voty, if [D, 5) < (Oc ay ies HW] 
= Vo + vy + V5 if [D, i S) + HY, < | eas D; + S; Hs] (3.2) 
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Using the representation of (3.2), the expected value can be expressed as 
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4. Given Data 


a. Battle Group Replenishment Parameters 
There are M receivers. Let the index rv identify a receiver; re {1, ... , M}. 


Receiver r requests v, lifts of ammunition. The total number of lifts to be sequenced 1s 


M 
L= yn, , 
b=] 


Lifts are pre-staged on the delivery ship in the sequence (determined by the 
model) so that breakout time at the delivery ship does enter this model. Helicopter 
pickup and drop-off handling times and flight speeds with and without loads are known. 
Each receiver 1s on an assigned (fixed) station for combat and replenishment, at known 
bearing and range from the delivery ship, and on formation course and speed. Given this 
data, delivery time to each receiver, 0, , and return fleht time from: each receiver, oe 
determined. Thus, if the /“ lift is delivered to receiver y, then D,—o0, , and K,— p.m 
total round-trip shuttle time between the delivery ship and each) receiver, 1s 6, + 9,. 

Strikedown times per lift for each receiver, y,, are known. If ine? ™ lita. 
delivered to receiver ry, then S,=wW, To be consistent with the assumption that 
S,< R,, forall 2. itis also assumed that w, < p,, for all r. Thus the following assump- 


tions have been made: 


Assumption 3.1: Helicopter delivery and return times, and strikedown times 


for each receiver are fixed constants. 


Assumption 3.2: To preclude the development of strikedown queues, 
V =< p. lor all. 


The next assumption concerns the air raid interarrival time. 


Assumption 3.3; Air raid interarrival time is a random variable, 7, assumed 


to have an exponential distribution with a known mean, ft. 


b. Battle Group Combat Value Function 

Here, a simple combat model is developed to derive a candidate for a given 
combat value function for the Battle Group. Further, an expression is derived for the 
marginal increase in combat value due to unit increases in the number of weapons 
available for combat in the Battle Group. 

Combat Model. \n this combat model the Battle Group is defended with 
several defenders from attack by a single bomber. The defenders are each of the ships 
in the Battle Group that, during replenishment, are referred to as the receivers. AS 
above, the defenders receivers are indexed by re {1,..., Af}. | Each defender has one 
anti-aircraft missile svsteni and several missiles. The number of missiles on each 
defender available for combat is called their missile state, denoted by s,. The missile 
state of the entire Battle Group 1s the vector of individual mussile states: (s,...., Sy). The 
defense fails if all missiles in the Battle Group fail to kill the attacker. The single shot 
kill probability of the mussile svstem on defender r, denoted bv p, ; and the probability 
that the attacker is engageable by defender r , denoted bv z, ; are given. For this simple 
model. assume that engageability by defenders 1s mutually exclusive (no overlap), and let 


m, denote the probability that the attacker is not engageable by any defender. Then, 


M 


» 7, =! 


r=0 


Combat Value Function. The measure of combat value (sometimes called a 
measure of combat effectiveness or uzility) of the weapons available, is taken to be the 
probability that the single attacker is shot down, expressed as a function of the missile 


state of the Battle Group. That is, define 


U(s,,... , Sy) = P [Attacker killed] 


In terms of given parameters, U can be written 


Nf 
U(s;. $y) =1— 1m — ) m= pe)” (3.4) 
<i 


Marginal Combat Value. An expression is now derived for the marginal 
combat value of transferring one additional missile to receiver r, whose current missile 


state iss. Using lower case to represent marginal value, define 
us.) = O(Si5 4-95, 1,20, Sy) — UGS ee 
Which, with (3.4), becomes 
u,(5,) = 2,2, (1—p,) (3.5) 


If the /* lift is delivered to receiver ry, then v,— u(s). The initial statesoieach cece em 
Sis clvene 
The properties of this particular combat value function upon which the re- 


sult of this prototype model depends is stated in the following assumption: 


Assumption 3.4: 
Marginal combat values for different receivers are additive, and are non- 


increasing functions of the weapons state. 


5. The Interchange Argument 
Now consider a particular ordering O, where hft A + 1 goes to receiver /, and lift 
A+ 2 goes to a different receiver j ; and then consider the change in expected value if the 
recipients of these two lifts are interchanged to give ordering QO, . 


From (3.3) the expected value under ordering O, can be expressed 


E(V(O,)) =Vot+v, P[T2D,+S,) 
++, Pll > Digan 
+ us) P[T26,+¥,4+ ,) 
shige | eatery) eno see o aateal p) (3.6) 
+ Vpe43 PTS Dyas + Spay t 6) + 0) + 6; + pp t+ Wy) 
+..4%) P| ieee Se eee 


and the expected value under ordering O, is 
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E[V(O;)] = Vo +» PIT D, + S\) 
+t Uy P[TS Dy t+ Spt W, 1] 
+ u,(S;) Pie 6; + Wi +0,+ p+ W | 
+ Vp 43 Pig = pay p43 +O; + 2; +O; Pren WV] 
Br sett P{[T> D,+ 5S, + Weyl ° 


(3.7) 


Subtracting (3.6) from (3.7), the difference in expected value is 


E[V(O.)}-— E[V(O,)] =ufs) P[T26,+¥,4+ ¥,) 
UNS er |? = Opt Wi; + 0; + Pee ae 
mAs = Onc yy, eRe, | 
mer fot y+, + Oe] 


(3.8) 


From (3.8), it 1s seen that the interchange vields an improvement (.e., 
Epc Onpe E[V(O,)] ) if and only if 


u(s) {P([T25,+¥,+ WI- P[T26,4+0,4+6;+0,+ Wd} 


> u(s){P[T26,+¥+ ,J- P[T246;4+¥,+6,4+0,4+ J} . (3.9) 


This condition applies for any distribution of 7. However, if 7 has an exponential dis- 
tribution with mean t , (3.9) can be reduced into terms separable in i and j. Using 


P[7 =x] =e-7”, this condition becomes 


— (6 +wu,) 6 — id 
u(5;) et u(s;) e (6, + w,); 


Me oe 3.10 
P="e5 (5; + p,)/t eg (0, + p,)/* ( ) 


Hence, (3.10) implies the main result of this prototype model (see Ross [Ref. 15. p.1$]). 


Result 3.1: Under Assumptions 3.1 through 3.4, the sequence of lifts which 


maximizes the expected combat value is in decreasing order of 


~—(6,+wW,)/t 
u,(s,) € 


1 eavem ae.) Se) 


The ratio of probabilities which multiplies the marginal combat value in (3.11). 


an 


eas f * 
e (6,+u,)/ 


] _ en r+ piit , 

can be thought of as a logistics weight, since it 1s a function of the times taken to transfer 
the lift (delivery, return and strikedown), and those times are the key logistics factors in 
the VERTREP problem. Also, to reflect the kev ideas of the combat replenishment 


problem (3.11) will be called a logistics weighted combat value. 


6. Prototype Model Optimal Sequence 
For the prototype combat value function, with marginals given by (3.5), the logistics 
weighted combat value of a lift is expressed by 


— (6 
MAS pe See 


ie e- (6, + p,)/7 


where the state variable, s,, takes on m, consecutive integer values starting with the initial 
weapons state, s,; and 7,, § , 7, D,, 0,, W,, and p,, tony — lj. ieand cde alleen 
constants. 

To show how the result might be used, an algorithm to obtain the optimal se- 


quence is given in Figure 7. 
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Step 0 (Initialize): 
Input t. VM 
L=0 
ot — 1... VM. 


(initialize total number of lifts) 


(for each receiver) 


pul 77,; Sata Oe pau, 


L=L+n, 

S,=§, 

SMAX, = S$, +N, 

EE el 2, 

— (6,+W,)/t 


T, Pr © 


C= 
] ts e- CRS biis 


ny = J, 
lwev, = C, p, 


= 
Scepel ior this lift): 
Best=0 


ener = |. es 
sec sa 
Liver = Bes: 
re =p 
Best = lwev, 
eo ae 20 
Sp = Spx + 1 
cater — (Creare 
Stem 2 (Next lift): 
Ee 
{/=/+ ]} 
Go to Step 1 
Step 3: 
Stop 


Figure 7. Optimal Sequence Algorithm 


(add up total number of lifts) 
(set initial state) 
(set final state) 


(collect constants) 
(collect constants) 


(logistics weighted combat value) 


(initialize: first lift) 


(initialize best /wcev) 


(Find optimal receiver) 


(output: optimal receiver) 


(update the state) 


(update fcr) 


Example 3.1. An example of a small Battle Group with only two receivers and 


few missiles is used to illustrate this model. The given data are shown in Table 1. 


Table 1. GIVEN DATA FOR EXAMPLE 3.1 


ee ee 


Tnitial State) —— 0 | 2 
Requests (in) —~«d| a iP a 


Single-shot kill 
Probability (p,) 


Engagement 
Probability (z,) 


Expected time between raids = 1.0 

















The optimal sequence algorithm of Figure 7 is used to find the ordering of lifts which 
maximizes the expected combat value of weapons available in the battle group when 


combat commences. The initial weapons state of the Battle Group is 
(Sj; Sj) = (072) = 
The marginal combat value of a lift to receiver | is 


u,(s,) = 2, p, (1 — py)" 
(.33)(.65)(1 — .65)° 
Die 


I 


The marginal combat value of a lift to receiver 2 is 


Uy(S2) = m2 p2 (1 — p2)? 


(.67)(.4)(1 — .4)° 
= 096 . 


The logistics weighting factor for a lift to receiver | is 


S (6, + Wy)/7 (304.25) i(1 0) 


ae (6, + p,)/t = la e—(-30+.30);(1.0) = 1.28 , 


and the logistics weighted combat value is (.214)(1.28) = .274 . 


The logistics weighting factor for a lift to receiver 2 is 


ew 62 + Wa)IF eo 15+.10)/(1.0) 


and the logistics weighted combat value is (.096)(3.00) = .288 . 


Thus, since .288 > .274, it is optimal for the first lift to be dispatched to receiver 2. The 
state of receiver 2 is then incremented bv one, and the second lift is considered; and so 
forth. A Fortran implementation of the optimal sequence algorithm is provided in Ap- 
pendix A. The output of the program is the optimal ordering, O. , which tells the decision 


maker to dispatch lifts to receivers 1 and 2 in the following sequence: 
On i ene ee 


Table 2 on page 26 shows the numerical results of the replenishment process under the 


optimal ordering. 


Table 2. RESULTS FOR EXAMPLE 3.1 


emt 
Dispatch Time (Wi) | - | 0.00 | 0.30 | 0.90 | 1.20 | 1.50 | 2.10 | 2.40 | 3.00 | 


Completion Time ; igs 
erst epeltats 
er [fos 

( Vy = u(s,) ) 

Probability of completion 

P(T> CT] O95 O29 


oa ol al 
jee 

a 
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et elle 


arrival in this state 
Expected Combat Value = 




















PICT, < T=Ciam 











7. Interpretation and the Exponential Assumption 


The assumption of the exponential distribution of 7, which possesses the 
memoryless property, was necessary to get the form of (3.10) in which the terms are 
separable ini andj. Although the result, (3.10), was obtained directly from (3.9), using 
the stated assumptions, a derivation of an intermediate form is useful to show clearly the 
necessity of the memoryless property of the exponential distribution of 7, and offer some 
interpretations of the results. 

Using the definition of conditional probability, the first probability term in (3.9) 


can be expanded as follows: 


PiT20+¥,+W,) = PiT20+¥,+W,17T2W x PiPeH,) . ale 


The last probability term in (3.9) can be expanded as follows: 


P[T>0;+ Wi +0) +p)+ Wi) 
=P(T26;+ Wit 6;+0;+ WITS 6,+ p+ Wy) (3.13) 
x P[T2=6,+9,4+V,|T2H,) x P[T2 J . 


Similarly, for the other probability terms in (3.9). 

Interpretations may now be made. Recalling that HV, is defined as the partial 
sum of delivery and return times through the &™ lift, it may also be interpreted as the 
dispatch tame for the k + 1* lift. Then the probability, P[7 => W,], may be interpreted 
as the probability that a k + 1 * lift can be dispatched. 

The conditional probability term in (3.12), P[T26,+¥,+W,|T=W,) may 
then be interpreted as the probability that a transfer to receiver / can be completed, if it 
gets dispatched at time TV, . 

Similarly, the first conditional probability term in _ (3.43), 
P[T2>6,+¥,+6,+9,+1',|T=>6,+,+ 1] may then be interpreted as the probabil- 
itv that a transfer to receiver / can be completed, if it gets dispatched when the helo re- 
turns from its round-trip to receiver /. 

In a similar manner, the second conditional probability term in (3.13) 
P([T26,+,+1V,|T=1¥,] may be interpreted as the probability that a helicopter 
round-trip to receiver j can be completed, if it gets dispatched at time }¥’,. 

This representation also implies that the decision concerning the choice between 
ordering O, and O, may be interpreted as deciding, at time }¥’,, which receiver gets the 
next lift to be dispatched. 

Getting back to (3.9), if all probability terms are expanded, it can be seen that 
the factor P[T > 1¥’,] is common to every term and therefore may be divided out. Then 
(3.9) becomes 


P(T2=6,4+¥,+,/T2 Wy 
u(s)| | PITS 6,+ Wj + 5,4 + WITS 6,4 9 + Wi) 
x P(T>6,+9,+ W,1T= Vy 
(3.14) 
P(T>6,+¥;+ V,|T= WY) 
> us) — | PIT 2 64+ ¥;,+ 6, + 9+ W,IT2 6+ p+ W,) 
x P[T25,+p,+,1T2 WV, 


It is here that the assumption that 7 has an exponential distribution is invoked. 
The memoryless property of the exponential implies that the second conditional proba- 
bility terms on each side of (3.14) can be reduced as follows (further reductions are 
possible, but this intermediate step is taken to derive a form of the logistics weights with 


a useful interpretation): 


PITS 5+ Wy +6, 4+ 0, + Wyl TZ 6, + 9, + W,) =P[T2 5+ 0+ Wy 1T2 W,) (3.15) 
Pa Ta ae W,\T= 6+ pyt+ Wy) = P[T26,+ y+ W,\T=W,)] (CMs) 
Using these reductions, (3.14) simplifies to 


P{T> 0, + Yi W,\T > W,| 
x P[T>6,+9,+W,1T= VW] 


(3.17) 
P(T>6,+¥;+W,IT= 4] 


> u(s;) a P(T>6,+¥;+4,1T= HY] 
x P[T26,+9,4+ 4, |T= W,] 


Then, as a direct consequence of the “micmomlessness “of 7, “the “terme 
P(T26,4+¥,4H,1T=W] , and P[T26,4+¥,+W,|T2W,] can be factored out, 


Separating terms in / and j.2 Equation (3.17) can then be rearranged as 


HS) el iO eet ia WATS Wy] . u(s) P{T>6,+,+ W,1T= Wy] 


3 . (3.18) 
1-P(T26,+o,4+h, ITZ) 1-P(T26,+9,4+ 1,172 HY) 


Thus the logistics weighted combat value of the alternative lifts evaluated for 


dispatch at time IV, 1s 


u(s,) P[T26,+¥,+ W,l1T> Wy) 


(3.19) 
1— P{T>6,+p,+,\T= 


for receivers r=1,..., V. 


_ 2 The separation also relies on factoring out the marginal utilities, and assumptions about the 
delivery and return tumes, which are discussed later. 
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The conditional probabilities in (3.19) provide an interpretation which is rea- 
sonable for determining the priority of a lift to be dispatched at time IV,. The proba- 
bility in the numerator may be read as the conditional probability that a lift dispatched 
at time IV, can have strikedown completed before a raid arrival, given that it can be 
dispatched before a raid arrival. This will be referred to simply as the conditional 
probability of strikedown completion. The probability in the denominator may be read 
as the conditional probability that a helicopter dispatched at time I”, can complete that 
transfer and be ready for another lift before a raid arrival, given that it can be dispatched 
before a raid arrival. This will be referred to simply as the conditional probability of 
round-trip completion. 


The logistics weight which is applied to combat value is thus 


(conditional probability of strikedown completion) 
1 — (conditional probability of round-trip completion) 


This is consistent with the intuitive idea that a lift with a shorter strikedown time should 
have a higher logistics weight than a hf{t with a longer strikedown time, and a lift that 
consumes less helicopter round-trip time (which allows subsequent lifts to be transferred 
sooner) should have a higher logistics weight than a hft that consumes more helicopter 


round-trip time. 


8. Transfer Time Assumptions 

Referring back to (3.6) and (3.7), it can be seen that the assumpuon that deliv- 
ery and return times be constant was necessary so that the sum 6,+9,+0,+p,+ IV, 
which enters the terms for the + 3 and subsequent lifts, does not depend on the order 
of deliveries to receivers i andj. That is, the 6, and p,, for example, can not depend on 
when that delivery starts. This permits those later terms to cancel when the difference 
in expected value is taken. 

The assumption that strikedown times (as well as the delivery times) be constant 
was necessary so that the y,, for example, that appears in the conditional probability 


teins 


P[T26,+¥+W,1T= MH, , 


and 


P(T2=6,+W,+6,+0,+ W,1T26,+0,4+ W,) , 


in (3.14), do not depend on the time at which the strikedown starts. Consequently, both 
of these conditional probabilities equal P[J > 6,+ w,] , which in turn permits separating 
terms iniandj. This is the motivation for the assumption that strikedown queues not 
develop on receivers. If strikedown queues could develop, then earlier lifts might delay 
the strikedown of subsequent lifts. Then strikedown times would depend on when and 
how many previous lifts were delivered. Strikedown queues could be precluded by 
blocking subsequent deliveries to a receiver if a strikedown is not completed, but it is also 
assumed that there be no blocking. This is necessary because if an earlier lift precluded 
a subsequent delivery to any particular receiver, then some orderings would be disal- 
lowed, and some interchanges may be blocked. Thus the interchange argument could 
not be applied. 

The condition S,< R,, for all ?, which further implied the condition y, < p,, for 
ally , is sufficient to ensure that no strikedown queueing (or blocking) could occur, but 
is stronger than it has to be. What is needed to preclude blocking and strikedown 
queues is to require that a lift to any particular receiver have strikedown completed be- 
fore another lift can be delivered to the same receiver. Referring to Figure 5 on page 
16 it is seen that the necessary condition for there to be no blocking or strikedown 


queueing is, for consecutive lifts to the same receiver, that 


S/SK, + Diageeeior | alee alee 


which in terms of a specific receiver becomes 


VV, Spee = for — 1h el ee (3.20) 


For this model, it 1s also necessary that strikedown completions occur in the 
same order in which deliveries are dispatched (i.e., an ordering O, refers both to the order 
in which transfers are started and completed). This requirement permits the completion 
times shown in Figure 6 on page 17 to be ordered, the combat value to be expressed as 
in (3.1) and (3.2), and the interchange argument to be applied. As with strikedown 
queueing and blocking, the condition S,< R,, for all /, which further implied the condi- 
tion YW, <9,, for all r, is sufficient to ensure that the ordering is maintained, but again 
stronger than necessary. Referring to Figure 5 on page 16 it is easily seen that the 


necessary condition for this ordering to be inaintained is that 
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S,< R, + Disa OT ell . (ae21) 


To see what this condition implies in terms of lifts to specific receivers, two cases can 
be considered. 


Case I: If consecutive lifts go to distinct receivers in the order i followed by /, 
(3.21) becomes 


Vi — p; S00, + Wy ; fori= ye ,M 
ja ary UE (O922) 
ixy 
Case II: If consecutive lifts go to the same receiver, then the ordering will be 


maintained due to the condition given by (3.20) which precluded strikedown queueing 
or blocking. 


Thus the following relaxation of Assumption 3.2 is applicable for Result 3.1: 


Assumption 3.2’: To preclude the development of strikedown queues, and main- 


tain the same ordering from the start of a transfer to its completion, 


w.<p,t+o, Ole = ee ; 
and 


Ui WOES (Oy a Yon — low 
j=l,.., M 
iz] 


9. Combat Value Function Assumptions 
Although a very specific combat model was used to derive a simple Battle 
Group combat value function for this model, only two properties of the function were 
necessary to the derivation of Result 3.1. The first property was additivity. It was nec- 
essary that the marginal combat values of lifts for each receiver not depend on the state 
of other receivers. The implication of this is that the total combat value for the battle 


group is the sum of the combat values of the receivers (1.e., there are nO cross terms in 
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the Battle Group combat value function). In this model, the additivity property was due 
to the assumption that attacker engageability by the defenders was mutually exclusive. 
The property was implicitly used in the interchange argument in (3.6) and (3.7), where 
the marginal value of the lift for, say, receiver i was the same whether that lift came be- 
fore or after the lift for receiver j/. Consequently, the marginal values factored out in 
(3.9), and ultimately permitted separating terms in / and /. 

The other necessary property was the concavity of the Battle Group combat 
value function. This property is necessary to preclude scheduling a receiver to get, say, 
his second replenishment missile before his first one. 

The assumption that marginal values are non-negative (and hence that the 
combat value function is non-decreasing) was used in this model, but is easily relaxed. 
Since the sequence that maximizes expected combat value is in decreasing order of the 
logistics weighted combat values, and the weights (a ratio of probabilities) are always 
non-negative, the replenishment process can simply be terminated after the last non- 
negative valued lift. 

Defining the combat value function as a probability of successful defense was 
completely arbitrary. Any utility function satisfying the additivity and concavity as- 
sumptions could have been used for the Battle Group combat value function. Appendix 
B presents a heuristic method that can be used to derive combat values, but that does 
not require a fine-grained specification of the Battle Group defense formation and spe- 


cific raid parameters. 


B. A VERTREP SCHEDULING HEURISTIC 


Some of the conditions under which the prototvpe model gives an optimal sequence 
are too restrictive for a real problem. However, even if all the conditions do not hold 
exactly, they may be close, and sequencing the lifts in decreasing order of logistics 
weighted combat value, hereafter LWCV, may give good, if not optimal, results. 

In this section, a more general VERTREP problem is defined, and a heuristic 
scheduling algorithm which uses the LWCYV criteria is outlined. The algorithm has been 
implemented, and a Battle Group example is presented. To examine how good a 
schedule the LWCV heuristic produces, a method taken from combinatorial optimiza- 


tion, called a local neighborhood search, 1s used to improve the solution for the example, 


Ly 


and the results compared. The chapter is then concluded with a discussion of the con- 


ditions under which the LWCV heuristic may be expected to produce a good schedule. 


1. The Battle Group Combat VERTREP Problem 

A typical Battle Group consists of several combatant ships (receivers) being 
supported by one multi-product combat logistics ship (deliverer) with a few logistics 
helicopters. Each combatant ship has several anti-aircraft and anti-missile weapons 
systems installed to provide a layered defense against air attack, as well as weapons for 
use against hostile submarines and surface units. 

Following an air attack, each receiver requests multiple lifts of each type of 
ammunition used. Aboard the delivery ship, different types of ammunition may take 
different amounts of time to breakout and prepare for transfer. Aboard the receiving 
ships, each type of ammunition is processed separately, and may develop its own 
strikedown queue. 

When the air attack ends, which marks the start of a replenisliment period, each 
combatant ship 1s in the vicinity of an assigned combat station which may be at a great 
distance from the logistics ship. At that time, the Battle Group Commander issues ma- 
neuvering orders based perhaps on tactical considerations, which determines the relative 
positions and relative speeds of the delivery ship and receiving ships for the duration of 
the replenishment period. For example, the delivery ship may be ordered to proceed on 
a particular course and speed, and the receivers may be ordered to close the delivery ship 
as fast as possible for replenishment, remain close for a while, and then proceed to take 
up new defensive positions by a particular time. 

The time available to conduct ammunition transfers, the air raid interarrival 
time, is a random variable. with an arbitrarv distribution. When another air raid arrives, 
it terminates the replenishment process; transfers in progress are not completed. 

From a scheduling theory viewpoint, job processing times are sequence- 
dependent. That is, several components of the total time it takes to process each 
VERTREP lift, depend on the lifts that have been sequenced ahead of them. Specif- 
ically, helicopter transfer time includes variable flight time which depends on the range 
of the receiver at the time of delivery. The range, in turn, depends on the time that the 
lift is dispatched, which depends on the time consumed by previous lifts. Also, the time 
that a receiver takes from when a lift is dropped off, until strikedown 1s completed de- 
pends on how long that lift must remain in a strikedown queue, which depends on when 


and how many previous lifts were delivered. 
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This feature of sequence-dependent processing times in a job sequencing prob- 
lem implies that the general Battle Group combat VERTREP problem is equivalent to 
the traveling salesman problem; see Conway, Maxwell, and Miller [Ref. 7, pp. 53-66]. In 
the combat setting of this problem, there may be as many as a few hundred lifts to 
schedule, and considering that with another attack anticipated, replenishment should 
commence as soon as the previous raid ends, a solution to this scheduling problem is 


needed quickly. Hence, the heuristic approach. 


2. The Combat VERTREP Scheduling Heuristic 
This heuristic for scheduling combat VERTREP is conceptually the same as the 
sequencing algorithm given in Figure 7 for the prototype model. 


a. Inputs. The following inputs are required: 


(1) An attack interarrival time distribution and estimates of the parame- 
ters of the distribution. 


It is assumed that the attack interarrival time is a random variable with 
range over the positive real line; for example, the exponential distribution or the gamma 


distribution. 


(2) An arbitrary Battle Group combat value function. 

No assumptions are made concerning the form of the combat value 
function. However, a sensible combat value function would be a non-decreasing con- 
cave function of the weapons state (up to the weapons capacity of each receiver), and 
an increasing function of weapon system and defender effectiveness. Appendix B pro- 
vides a discussion of the concepts and characteristics of a combat value function, and 
suggests a heuristic method of calculating combat values for every possible lift of am- 
munition in the Battle Group. Other forms of a combat value function may also be 
used. Since this scheduling heuristic uses a forward induction procedure, an arbitrary 
combat value function which depends on the current weapons state of the entire Battle 


Group could be used. 


(3) Battle Group maneuvering orders. 
It is assumed that the initial positions of each receiver relative to the 


delivery ship are known at the  itset, and that the maneuvering of the delivery ship and 
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receiving ships during the replenishment period has been specified. In addition to that 
input, to determine the variable helicopter flight time from delivery ship to each receiver 
and back at any time, the algorithm needs each receiver's relative closing and opening 
speeds, and relative helicopter speeds, out from the delivery ship with a lift, and return- 
ing to the delivery ship empty. The relative speeds may be computed given the following 
data: delivery ship true course and speed, receiving ships true stationing speed, helicopter 
true air speed (unloaded and loaded, with possibly different speeds for different tvpes of 
lifts), and true wind speed and direction; see Defense Mapping Agency Pub. 217 [Ref. 
P|. 


(4) Ammunition requirements and handling times. 

It is assumed that the ammunition requests and fixed handling times 
for all lifts are given before the generation of an initial schedule or a revision. The first 
input is the number of receivers. Then, for each receiver, the number of types of weap- 
ons must be given. Then, for each type of weapon on each receiver, a time to strikedown 
must be given, as Well as that receiver's capacity and current weapons state (from which 
the number requested is determined). Inputs related to delivery include the number of 
helicopters, and for each tvpe of ammunition carried by the delivery ship, the delivery 
ship breakout time. and fixed handling times for a helicopter to pick up a lift. and drop 
off a lift. Note that the total amount of time that a helicopter takes with a VERTREP 
lift includes fixed time to pick up plus variable flight time out to the receiving ship, and 
fixed time to drop off plus variable flight trme back to the delivery ship. The next section 
discusses the computation of total transfer times from the given inputs. In addition to 
the basic receiving and delivery inputs, initial conditions, which include specifving 
breakout status. helicopter status, and strikedown queue status for each weapon on each 


receiver, can be used to revise a schedule once a VERTREP 1s 1n progress. 


b. Transfer Times. At each helicopter dispatch time, the LWCV is computed for 
the next requested lift of every requested ammunition tvpe for every receiver. To do this, 
besides the combat value of each lift, the helicopter round-trip completion time, and 
strikedown completion time are needed. In the prototype model, delivery ship breakout 
times Were disregarded, strikedown queues were precluded, and the receivers remained 
on fixed stations, so tnat all the times were fixed constants. In this more general prob- 
lem, transfer times must be computed. The approach used 1s to represent the VERTREP 


process, from breakout at the delivery ship to strikedown at the receiving ship, as a 
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deterministic network, or PERT type system; see, for example, Elmaghraby [Ref. 23]. 
The desired transfer times which, in project scheduling terminology are events, are then 
obtained by a partial forward pass on the network. A helicopter may be dispatched at 
the later of its return from a previous lift or breakout completion of the current lift, plus 
the fixed time it takes the helicopter to pick up the lift. The time at which a lift is 
dropped off at the receiver is the sum of the time of dispatch plus variable flight time to 
the receiver plus the fixed time to drop off the lift. The event which marks the time of 
strikedown completion is the length of the current lift strikedown activity time added to 
the later of the previous strikedown completion event or the current lift drop off time. 
And finally, the event that marks the helicopter’s return from the current round-trip and 
readiness to pick up the next lift is the variable flight time returning added to the event 


time when the current lift was dropped off. Details are provided in Appendix C. 


c. Logistics Weights. The key element of this scheduling heuristic 1s the use of 
LWCV as a dynamic allocation index. Having already discussed the generation of 
combat values, it remains to consider the form of the /ogistics weights. From the pro- 


totype model. the form of the logistics weights in (3.19) 1s 


P(72>0,+¥,+ Wile WI 
1— P([T>6,+p,+1,1T= W,] 


Although this form of the logistics weight was derived for exponential air 
raid interarrival times, and is only exact in that case, it will be used as a heuristic for 
general distributions defined on the positive real line as well. Conditions under which 
this heuristic may be expected to produce a good schedule are discussed in the final 
section of thus chapter. 

The conditional probabilities are derived from the unconditional probabili- 


ties as follows: 


P[T>5,+,+ 


P(T26,+¥,+W,|T2=W,)= PiT= 


and 
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d. The Algorithm. The algorithm for the combat VERTREP scheduling heuristic 
is outlined as follows 


(1) Read inputs and initialize. 
(2) For the next available helicopter: 
¢ For each receiver: 
« For each weapon type: 
« Obtain the combat value of the next lift requested. 
« Calculate receiver motion and transfer times. 
« Calculate logistics weights. 
« Calculate LWCV. 
« Schedule the lift with maximum LWCV. 
« For the scheduled receiver / weapon: 
« Increment the weapon state. 
¢ Set the time of breakout completion. 
e Set the time of strikedown completion. 
« Set the time of helicopter return. 
(3) Ifthere are more lifts requested, go to (2). 
(4) Write the schedule. 
(=)ee Stop. 


3. A Battle Group Example 

This example considers the scheduling of VERTREP for a Battle Group con- 
sisting of four receiving ships each of which has four types of weapons to be replenished 
(from a computational standpoint, this is equivalent to eight receivers each with two 
types of weapons, or sixteen receivers each with one type of weapon, etc.). There is one 
delivery ship, one helicopter, and the total number of lifts requested is 97. The air raid 
interarrival time is assumed to be exponentially distributed with an expected air raid ar- 
rival of 4 hours. In this example, the four receivers are called Ship], Ship2, Ship3, and 
Ship4, and the seven different tvpes of ammunition within the Battle Group, are called 
WepA, WepB, WepC, WepD, WepE, WepF, and WepG. Appendix D contains the inputs 
and resulting schedule for this example. 

The first seven tables in Appendix D represent the inputs and computation of 
marginal combat values using the priority list method of Appendix B. The Battle Group 


ammunition summary is shown in Table 6 on page 191. The prioritized list of ammu- 
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nition by serial number for each of the receivers is shown in Table 7 on page 192 
through Table 10 on page 196. - The combined list, sorted by receiver priority, with 
Battle Group priorities assigned, is shown in Table 11 on page 197. The combined list, 
sorted by Battle Group priority, with marginal combat values calculated is shown in 
Table 12 on page 200. 

The next three tables give the logistics inputs. The ammunition requests from 
each receiver for each weapon type, and the time to strikedown each type of weapon are 
shown in Table 13 on page 203. For each type of weapon, the time for the delivery ship 
to break out a lift, and the fixed times for a helicopter to pick up and drop off a hft are 
shown in Table 14 on page 203. In lieu of delivery ship course and speed, receiving ship 
stationing speed and initial and final station range and bearing, helicopter true air speed, 
and true wind speed and direction, Table 15 on page 204 summarizes the relative speeds 
and ranges determined from the Battle Group maneuvering orders. 

The initial VERTREP schedule obtained with the LWCV heuristic is shown in 
Table 16 on page 205. The example was run on a Compaq Portable If computer with 
an 80286 CPU running at 12 Mhz. and an $0287 math co-processor. The schedule was 
produced in 2.52 seconds. 

The nature of the schedule reflects all of the considerations that have entered 
the modeling of this problem. For example, the first hft of WepA to Ship], the weapon 
with the highest combat potential in the Battle Group, occurs on the sixteenth helicopter 
delivery, which is in contrast to the first four consecutive scheduled lifts being weapons 
with much lower combat potential which are delivered to Ship4. The explanation for 
this involves the relative weapons states of all the receivers, and the logistics transfer 
times. With respect to weapons state, seen in Table 6 on page 191, Ship! starts off in- 
itially with ten of WepA, so that the first one requested would be the eleventh. In con- 
trast to this, each of the initial lifts to Ship4 start off in a weapon state of zero. This 
distinction is reflected in the marginal combat values in Table 12 on page 200. With 
respect to logistics transfer times, as seen in Table 15 on page 204, Ship] starts off ini- 
tially at a much greater range from the delivery ship than any of the other receivers, so 
that an earher lift to Ship! would consume much more helicopter flight time than lifts 
to the other receivers. Consequently, the lifts for Ship! get a lower logistics weight. The 


entire schedule may be similarly analvzed. 


4. Improvement by Local Neighborhood Search 

Whereas it appears, intuitively, that the schedule produced by the LWCV 
heuristic is not bad, it remains to be judged quantitatively how good it is. To get an 
approximate idea how close the initial schedule is to optimality, a method taken from 
combinatorial optimization, called a local neighborhood search, is used; see, for exam- 
ple, Kohler and Steiglitz [Ref. 24} or Parker and Rardin [Ref. 25]. 

The general strategy of a local neighborhood search in a scheduling problem is 
to start with some initial schedule, search in some chosen neighborhood of that schedule, 
adopting improvements as they are found, and continuing until no further local im- 
provements are possible in that neighborhood. For example, the smallest neighborhood 
for a scheduling problem is the set of schedules obtained by interchanging two adjacent 
jobs. 

The variant of local neighborhood search used here is based on the classic k-opt 
algorithm of Lin [Ref. 26] for the traveling salesman problem. Following Lin, a schedule 
is called k-opt if it is impossible to obtain a schedule which improves the value of the 
objective function by interchanging any & of the jobs. In the following, the initial 
schedule obtained with the LWCV heuristic 1s compared to the 2-opt and 3-opt sched- 
ules. (Lin’s results say that 4-opt schedules are not worth generating, in that they re- 
quire much more time to produce, and that their probability of being optimal is not 
noticeably better than for the 3-opt schedule.) 


The performance of the initial schedule compared to the local neighborhood 


search improvement is shown in Table 3. 


Table 3. INITIAL SCHEDULE VS. LNS IMPROVEMENT 


Schedule Initial 2-Opt 3-Opt 
: LWCV Heuristic LNS Improvement LNS — ement 


Expected 
Combat 17871.8 17882.3 
Value 
Percent 969% | 9 0/, 99.9% 100% 
3-Opt 
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The 2-opt VERTREP schedule is shown in Table 17 on page 207 and the 3-opt 
schedule is shown in Table 18 on page 209. They may be directly examined to see how 
they differ from the initial schedule listed in Table 16 on page 205, however a snapshot 
of projected completions at a particular time provides a good picture of the qualitative 
differences between the initial and k-opt schedules. The projected number of strikedown 
completions for each weapon type on each receiver at the expected time of the next raid 
arrival is summarized in Table 4. The numbers in parentheses show additional hfts for 
which the transfer is projected to be completed by E(T), but for which strikedown is not. 


Table 4. TRANSFERS COMPLETED AT E(T): LWCV HEUR. VS K-OPT 


Strikedown 


Receiver Completions 
Heur. ZAC IONE 3-Opt 


Shipl 4 (+2) 6 (+1) 6 (+1) 
Shipl 2 2 2 
Shipl 2 2 

Shipl 0 0 


Sloaljey” 
Ship2 
Ship2 
Ship2 


o-oo 2 


regal 33s! 
Ship3 
Sala os 
Sila om 


Ship4 
Ship4 
Ship4 
Ship4 


One -& ONN WN 





This summary shows the qualitative improvement achieved by the local neigh- 
borhood search. At this particular time, the improved schedules permit two more 
strikedown completions of WepA on Ship], and avoid the development of a strikedown 
queue. This is a noteworthy improvement since that is the weapon with the highest 


combat potential and longest strikedown time in this example. However, looking over 
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the entire table, it may be seen that the initial schedule is reasonably close to the 2-opt 
and 3-opt schedules which took so much longer to generate. This summary does not 
show any difference between the transfer completions under the 2-opt and 3-opt sched- 
ules, because, as may be seen in Table 17 on page 207 and Table 18 on page 209, they 
differ only by a permutation of a few lifts which slightly improves the objective function 
value, but does not change the number of projected completions prior to the expected 
time of raid arrival. 

It should be noted that the exhaustive all-pairs and all-triples interchange 
searches used here are certainly not the only alternative to staying with the initial 
schedule. A great many possibilities that exploit the characteristics of the combat 
VERTREP problem can be easily envisioned to heuristically improve the initial schedule 
Within a user specified reasonable time. The purpose here was to get a feeling for how 
good an initial schedule the LWCV heuristic generated. Heuristic improvement of the 


initial schedule is left for future consideration. 


5. Favorable LWCV Conditions 
In this section, the conditions under which the LWCV heuristic mav be expected 
to produce a good schedule are discussed. These conditions are based on the prototype 
model assumptions which permitted the use of the interchange argument in sequencing 


and ultimately the separation of terms leading to the LWCV optimality criteria. 


a. Combat Value Function. With respect to the Battle Group combat value 
function, the LWCV criteria is exact if the marginals are additive, as in the prototvpe 
combat model, or the combat value priority list method of Appendix B. For an arbitrary 
combat value function which may not have additive marginals, the LWCV criteria may 
still be good if cross terms due to small increments in the weapons state of other re- 


celvers are not appreciable. 


b. Air raid interarrival time distribution. With respect to the air raid interarrival 
time distribution, the LWCV criteria is exact with the exponential distribution. 
Markovian interarrival times may be a plausible assumption based on the following 


conditions: 
Next missile attack may be submarine launched and occur at any time. 


Next attack may be by stragglers from the last wave. 
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Next wave may be another bomber regiment with uncertain interarrival time. 

Next wave may be the same bomber regiment after an uncertain turnaround. 

Next wave may be delayed indefinitely (1.e., an “independent” subsequent attack not 

directly tied to the previous wave.) 
For an arbitrary distribution, the LWCV criteria may still be good if the conditional 
probabilities statements in Equations (3.15) and (3.16) are approximately true. This 
might be the case if helicopter round-trip time were insignificant with respect to the 
other terms in (3.15) and (3.16), which could occur when the receivers have closed the 


delivery ship -- the situation in which VERTREP is the most efficient. 


c. Strikedown Queues. With respect to the development of strikedown queues for 
each Weapon on each receiver, the LWCYV criteria is exact 1f no strikedown queue exists 
whenever a receiver has a lift dropped off. Strikedown queues are precluded (trivially) 
for each receiver's first delivery. Strikedown queues are precluded if helicopter round- 
trip time is longer than weapon strikedown time (as was assumed in the prototype 
model). Strikedown queues may be avoided even if helicopter delivery cvcle is shorter 
than receiver strikedown time, if the resulting sequence spreads out deliveries within the 
Battle Group such that intervening deliveries of other Weapons to the same receiver and 
deliveries to other receivers delay subsequent deliveries of the weapon with the long 
strikedown time. This might tend to occur due to a combat value function which tries 


to balance the weapons states in the Battle Group. 


d. LWCV Numerator. With respect to the product of marginal combat value and 
conditional probability of strikedown completion in the LWCV numerator, the LWCV 
criteria is exact under the conditions discussed above for each term individually, and may 
be good if both individual terms are good, also as discussed above. In addition to those 
conditions, the LWCV criteria may be good anyway if the departures from exactness of 
the two terms offset each other in the product. This may occur if marginal combat 
values are decreasing (as will usually be the case in the setting of this problem) and since 
any strikedown queue will diminish with time, the conditional probability of completing 
strikedown of the next lift may be increasing in short time periods around each dispatch 
time. Hence, the product may give a good approximation even if both terms are not 


individually good enough. 
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e. Later Lifts. The interchange argument required the expected vaJue contrib- 
ution of later lifts before and after the interchange to cancel out. This condition is exact 
if the sum of helicopter round-trip times to any two receivers, in either order, are equal, 
and if no strikedown queues develop for later lifts. The conditions related to strikedown 
queues are the same as discussed above. The equality of the sum of helicopter round- 
trip times is guaranteed if the receivers are non-maneuvering during the entire replen- 
ishment process. It may also be the case during portions of the replenishment process 
when the receivers are steady on replenishment stations, or combat stations. Even when 
the receivers are maneuvering, the sum of round-trip times mav be approximately equal 
if the relative motion of receivers i and j with respect to the delivery ship are similar (1.e., 
both opening or both closing at close relative speeds). 


Collectively, the conditions under which the LWCV heuristic may be expected 


to produce a good schedule cover a great many possibilities that may be encountered in 
a real problem. 
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IV. THE COMBAT CONREP PROBLEM: STOCHASTIC SCHEDULING 
OF GROUPED JOBS 


A model is developed in which the ships of the Battle Group are scheduled for con- 
nected replenishment (CONREP). Dynamic programming is used to maximize the ex- 
pected combat value of the weapons available at the stochastic time when the 
replenishment terminates and combat commences. In the terminology of flow shop 
scheduling, the time available to conduct the replenishment determines a stochastic due 
date, and the objective, or scheduling criterion, is equivalent to minimizing the weighted 
number of late jobs; the weights in this model are called marginal combat values. The 
decisions include the optimal partitioning of the receivers into sets assigned to each 
available deliverv ship side, the optimal order in which receivers are sequenced alongside 
the delivery ship within each set, and the optimal allocation of time alongside the deliv- 
ery ship to each receiver. These decisions collectively will be referred to as the 
schedule. Initially, a schedule is developed which specifies the optimal decisions for the 
entire process given the information available at the outset. This type of schedule is 
what Pinedo [Ref: 10] calls a sraric list policy since the schedule can be thought of as ar- 
ranging all the jobs to be performed in a list in the order in which they will be performed 
from the start. Since additional information may become available as the process pro- 


ceeds, the model will ultimately be extended to include dynamic revision of the schedule. 


A. DESCRIPTION OF THE COMBAT CONREP PROBLEM 

The problem is scheduling CONREP within a Battle Group which contains one de- 
livery ship and several receiving ships. The delivery ship can conduct two connected 
replenishments in parallel (literally) at port and starboard side replenishment stations. 
Each receiver requests several deliveries, or /ifts, of ammunition. The time available to 
conduct ammunition transfers, the air raid interarrival time, 1s a random variable. The 
times to conduct transfers to each receiver, which include delivery times and receiver 
strikedown times are assumed to be deterministic. When an air raid arrives it terminates 
the replenishment process; transfers in progress are not completed. While alongside the 
delivery ship, each receiver gets some consecutive number of lifts, which may be thought 


of as grouped jobs. 


B. OPTIMAL INITIAL SCHEDULE 

A model] to determine an optimal initial static list schedule is built up in steps which 
consider one aspect of the problem at a time. Initially, a single server (one delivery ship 
side) is considered. The order of the receivers alongside is arbitrarily fixed, and the op- 
tmal allocation of time alongside to each receiver is determined. The model is then ex- 
tended to include the determination of the optimal sequence of receivers. That model 
is then extended to consider the optimal partitioning of receivers into sets assigned to 
each available delivery ship side. 


I. Single Server, Fixed Receiver Sequence, Optimal Allocation 
There are R receivers. Let the index / identify each receiver; j = 1, ..., R. Receiver 


j requests m, lifts of ammunition. 


Assumption 4.1: Each receiver gets at most one opportunity alongside the de- 


livery ship. 


Backward induction will be used to determine the allocation of time alongside 
the delivery ship to each receiver which vields the optimal expected combat value. De- 
fine the stages of the induction as the number of receivers remaining to be served, in- 
Gexed by r,r=1,..., R. For notational convenience, let the index ; which identifies each 
receiver correspond to the stage in which each is served (i.e.,7=r ). For example, the 
first receiver to be served is identified by the index j = R since there are R receivers re- 
maining to be served including itself; and the last receiver to be served is identified by 


thendex j= |. 


Assumption 4.2: Once alongside, the lifts are delivered to each receiver in a fixed 


sequence. 


Let the index / define the fixed sequence in which lifts of possibly differing na- 
ture are transferred to each receiver; /=1,...,7,. 

Let x) denote the elapsed time from the moment when receiver j commences 
replenishment until the delivery ship completes transferring the /* lift. 

Let c( denote the elapsed time from the moment when receiver 7 commences 


replenishment until completion of strikedown of the /" lift. Strikedown completion time, 
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c(), equals transfer completion time, x(/), plus handling, waiting, and strikedown time 
on the receiving ship. These variables are depicted in Figure 8. 

Although no assumptions are made concerning the initial transfer completion times, 
x1), it will typically include serup time for the receiving ship to maneuver alongside the 


delivery ship and connect transfer equipment. 


Assumption 4.3: All receivers can be ready to start replenishing at the time des- 


ignated for the replenishment to commence. 


In the terminology of stochastic scheduling, Assumption 4.3 says that all jobs are re- 
leased at the outset. 

Let v() denote the marginal combat value of the /' lift delivered to receiver j. 
This marginal combat value accrues when strikedown is completed, if the raid arrival is 


later than strikedown completion. 


Assumption 4.4: The quantities (4) may depend on the weapons state of receiver 


Jj, but are independent of the weapons states of the other receivers. 
Assumption 4.5: The v{J) are non-negative. 


Assumption 4.6: The air raid interarrival time has an exponential distribution 


with a known mean. 


Let the random variable 7 denote the air raid interarrival time, with mean tf ; 
and F(t) = PLT2=7] = e-”. 

Let the decision variable k, denote the number of lifts to deliver to receiver j; 
k,€ {0,l,...,%}. Then the time alongside allotted to receiver / is the transfer completion 
time, x(k,); where x(0) = 0. 

Let f, denote the total expected combat value with r receivers remaining to be 
served, if the number of lifts allotted are k,,...,k,,k,, respectively, to each remaining 
receiver. Let f* denote the maximal f if the optimal number of lifts, k,*, are allotted to 


Each Temainin’ Teecel cl. | — ieee. 
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Figure 8. CONREP Process 


Proposition 4.1: (a) Under Assumptions 4.1 through 4.6, for a single server, and 
a fixed sequence of receivers, the maximum expected combat value with r receivers re- 


maining to be served, 1s 


he = max LV CK) + FO(K)) Ga*] (4.1) 
fom — 2... .; and 
fit =Vilm) ; (4.2) 
where 
: 
V,(k) = d%) Flc,()) , 


and where v,(0) = 0, and c,(0) = 0. 
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(b) The optimal decision at each stage (1.e., the optimal number of lifts to allot 
to receiver r), &,* , for r=2,..., R, is the argument which maximizes the functional 


equations (4.1); and k,* = 


Proof 1 (Backward induction argument): With r receivers remaining to be served, 
the expected immediate return if the decision is to allot k lifts to the next receiver to be 
served, is the expected combat value contribution 
k 
Vk) =) VD F(o(D) , 


0 


Le) 


where v,(0)=0, and c(0)=0. Using the memorvless property of the exponential dis- 
tribution, the expected future return is zero if the process 1s interrupted before transfers 
to the current receiver are completed, and is f_,*, if the process 1s not imterruptedvane 
the remaining r — I receivers are served optimally. If the decision is to allot & lifts to the 
next receiver to be served, then the probability that the process is not interrupted is the 
probability that the delivery of & lifts to receiver r is completed F(x,(k)) . Hence 
Equation (4.1) follows from the classic backward induction argument. Equation (4.2), 
the initial condition, follows directly from Assumption 4.5. @ 

Proof 2 (A detailed derivation): The total expected combat value for the entire 


CONREP process can be expressed as 


Sr = *r(1) F(ce(1)) + vp(2) F(cp(2)) + + valk) F(cr(kp)) 
+ ¥a(1) F(caa(1) + ¥p(&R)) + Yea(2) F(cpa(2) + xR(Ka)) 
+5 _1(Kp-4) Elcnmnepeieriecn (ep) 


| _ A me i (4.3) 
Hah F(a - sth) ae) F(a +), sth) 
j=2 j=2 
R 
= a Vik, F( su, ta »j sth) 


j=2 


Using the assumption of the exponential distribution, the F(x.(k.)) terms can be fac- 


tored out, and Equation (4.3) can then be rewritten as 
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fa = Lva(1) F(ce(1)) + ve(2) F(ca(2)) + + velkg) Flce(kg)) 
ry F(xp(kp)) Dvp_i(1) F(ce_,(1)) + Vp_,(2) F(cp_,(2)) Sta (da isn (dea, )) 


| (4.4) 
R 
+ | | Fee) Dod) Fley()) + »,(2) Fley(2)) + + 40h) Fley(ky))I 
j=2 
Define the conditional expected combat value contribution of receiver j as 
k 
k)= > (Flo 
i= 
where v.(0) = 0, and c(0) =0. Then Equation (4.4) can be rewritten as 
‘alkie) + Flaalke)) Vauilkgat) +o" + SG F(x(k)) Valk) (4.5) 
j=2 
Or equivalently, as 
Sr = Vrlkp) + Flxe(kp)) 
(4.6) 


x [Va kea) + Flea ake) [  DVolko) + Fath.) £%(4)0 )-. ] J 


Using the representation of Equation (4.6), it is seen that (2 can be maximized 
by successively maximizing terms in brackets, starting from the innermost pair. This is 
a backward induction on the number of receivers remaining to be served. Thus, the 


functional equation (4.1) has been obtained for r = 2,..., R; and 


YS ee ea LL aie (4.7) 
k=0,1,..., 7 


Since the v(/) are assumed to be non-negative, then V,(k) 1s non-decreasing in the argu- 
ment &, and thus f;* is obtained by setting & at its upper bound, », (1.e., k,|* =”, ); giving 
Equation (4.2). s 


2. Single Server, Optimal Receiver Sequence and Allocation 


This model is now expanded to include the determination of the optimal se- 


quence of receivers, as well as the optimal allocation of time alongside to each receiver. 
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Clearly, one approach to this optimization could be to use Equations (4.1) and 
(4.2) to evaluate f,* for the R factorial possible sequences in which the receivers can be 
scheduled alongside the delivery ship. Considering that a typical battle group has only 
six to eight receiving ships, total enumeration of all possible receiver sequences is com- 
putationally feasible. However, computational savings may be obtained by using a 
backward induction which implicitly enumerates all possible receiver sequences. 

The stages of the induction are defined, as before, as the number of receivers 
remaining to be served, numbered with the index r. 

Define states at each stage as the subsets of receivers remaining to be served 
(i.e., each state is a list of the identities of the receivers remaining to be served).3 Let s 
denote such a state. For example, for R=3, the possible states at stage 2 are 
s= {1,2}, s= {1,3}, and s = (2,3)}aeat Stave 7 i encedne ic) such states. Let S, denote 


» 
the set of possible states at stage r. For example, for R= 3 


Si ={ {ip A203} f 
S2={ (1,2},{1,3},{2,3} } 
S3 = { {ince } ’ 


It is also convenient to use the set theory notation of difference or relative complement. 
Let s\{j} denote the set which contains the elements which belong to s but not including 


the element j..F or example, 1! 5 — p23 then 
Si) = es) ae 


Functional equations can now be written to recursively solve for the sequence 
of receivers and allocations of time alongside which maximizes expected combat value. 
Let f/*(s) denote the maximal expected combat value obtained by deciding on the opti- 
mal sequence of remaining receivers, and the optimal number of lifts to allot to each 


remaining receiver. 


Proposition 4.2: (a) Under Assumptions 4.1 through 4.6, for a single server, the 
maximum expected combat value with r receivers remaining to be served, where the 


identities of the yr receivers are the elements of the set s, is 


3 This use of the word state follows the classic terminology of dynamic programming as used, 
for example, by Bellman [Ref. 17]. This particular choice of state space used to formulate functional 
equations in this problem should not be confused with the weapons state used elsewhere in this 
work. 


Jes 


J, (s) = max ees .L Vk) + F(x,(k)) asa : (4.8) 
forallse S, and forr=2,...,R; and 


i Vata) (4.9) 


forj7—l,2,...,R. 

(b) T The optimal decisions for each state at stages r =2,..., R are the arguments 
which maximize the functional equations (4.8). These nae give the identity of the 
optimal receiver to schedule for service in that state at that stage, and the corresponding 
optimal number of lifts allotted to that receiver. 


Proposition 4.2 conforms to the principle of optimality as given by Bellman [Ref. 
17): 
An optimal policy has the property that whatever the initial state and initial decision 


are, the remaining decisions must constitute an optimal policy with regard to the 
state resulting from the first decision. 


Example 4.1. As an example of how the induction would proceed, for R = 3, 
Equations (4.8) and (4.9) would be expanded as follows: 


AFG) = Vin) 
f\7(2) = Vn) 
Ay*(3) = V(r) 


max LMA) + F(x,(k)) f*(2) | 


k=0,1 


f,7(1,2) = max me tv (A) + F(x,( (k)) A*(1) | 


max [V(4) + Fu() £70) 


_ ei [¥3(k) + F(xx(4) A*() J 


max [¥2(4) + Fea) £*0)] 


PEAKS), = max /_max [ ¥3(k) + F(x3(k)) fi*(2) | 


5] 


ee [ V4(k) + F(x,(k)) A*(2,3) | 
Ga ines) = max pens aL V4(k) — F(x5(k)) leon 
pmax [¥a(h) + Fea) £°1,2)] 


In this example, it is seen that, in the third stage, with receivers 1, 2, and 3 re- 
maining to be served, the three factorial possible receiver sequences are implicitly enu- 
merated by considering only the three cases of serving one receiver followed by serving 


the remaining two optimally. 


The computational complexity of using the backward induction of Proposition 
4.2 is of order 7R?2" versus total enumeration of all receiver sequences which 1s of order 
nR?(R—1)!; where n is the average number of lifts requested per receiver. Thus con- 


siderable computational savings are obtained for R> 5. 


3. Two Servers, Optimal Partition, Sequence and Allocation 

Besides computational improvement, another advantage of using Equations 
(4.8) and (4.9), 1s that the intermediate results, f*(s) can be directly applied to extend the 
model to two servers (i.e., parallel service at port and starboard delivery ship stations). 

Let s denote the complemient of state s. For example, for R = 3, if s = {1,3}, then 
s = {2}; if s = {1,2,3}, then s = {0}; etc. Let P denote a partition of the receivers into the 
sets sands. 

Let f(P*) denote the maximum expected combat value which is attained with 


the optimal partition P*. 


Proposition 4.3: If f*(s) is obtained using Proposition 4.2 for a single server, then 
the optimization over all possible partitions of receivers between two servers can be 


written as 


f(P\) = max [A +f) | : (4.10) 


eee 
se S, 


where f,*(0) = 0. 
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There are 2" such partitions. However, since the partitions {s,s} and {s,s} are 
symmetric, only half that number, or 2% partitions need be considered. Again, consid- 
ering that a typical battle group has only six to eight receiving ships, 2’ comparisons is 
computationally reasonable. 


Example 4.1 (continued). Continuing the example for R = 3, Equation (4.10) 
expands as follows: 


f*(1,2,3) 
Ar(12) +403) | 
AX(13) + A202) 1° 
fy*(2,3) + f.(0 


FT (P*) = max 


where all f/*(s), for y<3 on the right hand side are intermediate results obtained in 


computing f,*(1,2,3) using Proposition 4.2. 


This procedure can be easily specialized to consider selected partitions if, for 
example, some receivers are restricted to a particular delivery ship side, such as in the 
case for an aircraft carrier which can only replenish from the port side of the delivery 
ship. 


4. Computer Implementation 

The dynamic programming recursions of Propositions 4.2 and 4.3 have been 
implemented in FORTRAN and run on an IBM 3033 computer at the Naval Postgrad- 
uate School. Sample problems with up to eight receiving ships in a Battle Group, re- 
quiring up to 50 lifts each, executed the recursion in less than two tenths of a second 
CPL time. Larger problems are computationally feasible, but not of practical interest 
in the context of a Battle Group. 

A concise version of the program 1s listed in Appendix E. The following four 


ship example demonstrates the use of the program. 


Example 4.2. This is an example of a CONREP scheduling problem for a small 
Battle Group with one delivery ship capable of providing connected replenishment on 
two sides, and four combatant ships. A summary of the ammunition requests 1s shown 


merieure 9. 
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Figure 9. Example 4.2 Summary of Ammunition Requests 


The complete list of the individual ship requests by lift, giving the CONREP 
dvnamic program inputs, including combat values, transfer completion times and 
strikedown completion times, are listed in Appendix E. The procedures described in 


Appendices B and C were used to generate that data. 


The Resulting CONREP schedule for Example 4.2 is shown in Figure 10. 


The Battle Group Commander is assured that this schedule maximizes the ex- 


pected combat value of weapons strikedowns completed before the uncertain time at 


Which the next raid arrives. However, summarizing the results another way provides a 
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Delivery side 1: 
Receiver Number of Lifts Time Alongside 
3 10 1.24 
2 Zo 2. 80 


Delivery side 2: 
Receiver Number of Lifts Time Alongside 
4 7 0. 88 
il 4] 4.96 





Figure 10. Example 4.2 Resulting CONREP Schedule 


better picture of what this schedule provides. Considering the times of strikedown 
completions, the projected weapons state of the Battle Group at the expected time of the 
next raid arrival is summarized in Figure 11. The numbers in parentheses show addi- 
tional lifts for which the transfer is projected to be completed by E(T), but for which 
strikedown is not. This summary shows that although receivers 3 and 4 were cut off in 
the CONREP schedule, thev were scheduled to receive a fair share. Also reflected in the 
summary, is a scheduling trade-off for receivers 1 and 2. Although each was scheduled 
last on their respective delivery side, so that at E(T) their weapons strikedown com- 
pletion was less in percentage than the other receivers, there is good probability that 


they will be able to complete additional strikedowns. 


C. DYNAMIC SCHEDULE REVISION 

In this section, the problem of dynamically revising the optimal receiver sequence, 
lift allocation, and partition between two servers is considered. Two distinct motivations 
for dynamic schedule revision arise in this problem -- new information and release 
dates. 

The setting in which the first arises, is that after the process has been in progress for 
some time, new information may become available which suggests revising the schedule. 
One type of new information concerns the deterministic times to conduct transfers. 
These times are determined by parameters which may change (and can be observed). 
For example, a receiver in progress may have an equipment malfunction from which 
revised strikedown completion times may be obtained. Another type of new information 


concerns Assumption 4.6, that the air raid interarrival time has an exponenual distrib- 
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Figure II]. Example 4.2 Projected Weapons States at E(17). 


ution With a known mean. Of course the mean will not truly be known, but rather esti- 
mated (perhaps by intelligence analysts). As time goes by, the Battle Group may get a 
revised estimate of the expected air raid arrival time, Which should be used to revise the 
schedule. 

The term dynamic is used to capture the idea that the revision takes place while the 
process 1S in progress, and takes into account new information as it becomes available. 
It should be noted, however, that the revised schedule will be a new static list which 
specifies the remaining process given the information available at the time of the re- 
vision. 

The second motivation for dynamic schedule revision relates to the property that it 
provides a new Static list, and concerns Assumption 4.3 -- that all receivers can be ready 
to start replenishing at the time designated for the replenishment to commence (i.e., that 
all jobs are released at time zero). In the combat CONREP setting, it is common that 
the receivers would arrive at staggered times (which would be known). In the terminol- 
ogy of scheduling theory, these would be deterministic release dates of jobs. An intuitive 


argument for developing an approach to the release date problem using dynamic sched- 
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ule revision, 1s that up until the moment when a new receiver arrives, the stochastic time 
available should be used optimally for the receivers who are present (i.e., an optimal in- 
itial schedule), and then, if a raid has not terminated the process before the arrival of a 
new receiver, use the remaining stochastic time optimally for the receivers present in- 
cluding the new arrival (i.e., dynamic revision). 

The dynamic schedule revision approach is developed in steps starting with some 
special cases. 


1. Simple Revision 

Propositions 4.2 and 4.3 will be modified to provide for revising the optimal lift 
allocation for the receiver(s) in progress, and for the receivers who have not yet started 
service, revising the optimal sequence, the optimal lift allocation, and the optimal parti- 
tion between two servers. 

This revision is called simple because none of the assumptions previously made 
will change. In particular, Assumption 4.1, that each receiver gets at most one oppor- 
tunity alongside the delivery ship, will continue to be a condition of simple revision. 
Also, any continuing service to a receiver in progress, is constrained to follow imme- 
diately before any service to the remaining receivers. The model following this one will 
consider interrupting and rescheduling a receiver in progress. 

Additional notation 1s now introduced to describe the process from the moment 
When a simple schedule revision is made. Let ja denote the identity of the receiver in 
progress at server a. Double character variable names are used to avoid an additional 
level of sul’scripting. The second character, a , represents a letter designation for the 


server. 


Example 4.3. In the context of this problem, where the servers are the sides of 
the delivery ship, the receivers in progress are denoted jp and js to represent the port and 


starboard sides, respectively. 


The identification of a receiver in progress, ja, can be null if the server is idle. 

For receiver ja, let /, denote the index number of the lift in the process of being 
transferred. If a revision is to be made at the moment when a transfer to receiver ja 1s 
completed, then /, is defined to be the index number of the transfer just completed to 
receiver ja. Define remaining transfer completion and strikedown completion times for 


receiver ja as x,() = x,,(/) —1,, and ¢,() =c,(J —1,, for/=1,...,m.; where /, is the elapsed 


S| 


time Since receiver ja started service. Also, define the remaining expected combat value 


contribution of receiver ja as 


kK 


(4) = ) wall) Feel) 


i=l, 


Let S’ denote the set of receivers who have not yet started service, and let R’ 
denote the total number of receivers in S’. Also let S” denote the set of receivers in 
progress, and let R” denote the number of receivers in S”. In the context of this prob- 
lem, R” € {0, 1, 2}. 

The stages of the induction are defined, as before, as the number of receivers 
remaining to be served, numbered with the index r; and states are defined, as before, as 
the subsets of receivers remaining to be served. Here, however, it 1s convenient to dis- 
tinguish the intermediate states in stages 1 through R’ which include only those receivers 
who have not yet started service. Let s’<S’ denote an intermediate state. An additional 
final state can be defined for each server in stages 2 through R’ +1 by adding the receiver 
in progress to an intermediate state in the previous stage. Using the set theorv notation 
for union, let s’ LJ {ya} denote such a state. In stage 1, the final state for server a is 


{ja}. As before, let S, denote the set of possible states at stage r. 


Example 4.3 (continued). If there were initially R = 5 receivers, and under the 
initial schedule, receiver 3 has completed service and the receivers in progress are jp = 2 
and js = 5, then S” = {2,5} , R° =2 , and the set of receivers who have not yet started 
service 1s S’ = {1,4}, and R'’=2. There are two possible intermediate states at stage 1 
(one receiver to be served) which are s’ = {1} and s’ = {4}. The possible final states at 
stage 2 for the port side of the delivery ship are s’ LU {jp} = {1,2}, and s’ U {ip} = {4,2}, 
since the final state for that side includes the receiver in progress (and any continuing 
service to that receiver follows immediately before any service to the remaining receiv- 
ers). Also, the possible final states at stage 2 for the starboard side of the delivery ship 
are s’ () {js} = {1,5}, and s’ U {js} = {4,5}. All of the possible states are shown in 
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Table 5. 


Table 3. EXAMPLE 4.3 POSSIBLE STATES 


Possible States ( S_ ) 
Stage (r) 


a 















Intermediate states 


(s’ ) 





Functional equations can now be written to find the optimal schedule revision 


when there is at least one service in progress. 


Proposition 4.4: Under Assumptions 4.1 through 4.6, 


(a) The maximum expected combat value with | receiver remaining to be served, 


AFG) = Vy); (4.11) 


tory eqs |) S”}; 
(b) For intermediate states s’, the maximum expected combat value with r re- 
ceivers, who have not yet started service, remaining to be served, where the identities of 


the ry receivers are the elements of the set s’, 1s 


jes’ 


fee) = max [max [y+ Fore) farce] |i @12 


for alls’ < S,, and for r=2,..., R’; 


(c) The optimal decisions for each intermediate state s’ at each stage are the 
arguments which maximize the functional equations (4.12). These decisions give the 
identity of the optimal receiver to schedule for service in that state at that stage, and the 
corresponding optimal number of lifts allotted to that receiver; 

(d) For final states which include each receiver in progress, ja , the maximum 
expected combat value with r+ 1 receivers remaining to be served, where the identities 


of the r+ 1 receivers are the elements of the set s’ LJ {a}, 1s 


farts’ U {a}) = pax, | VK) + FSA) £(8') |; (4.13) 
for all s’ e S,, and forr=1,..., R33 
(e) The optimal decision for each final state s’ UJ {ya} at each stage 1s the argu- 
ment which maximizes the functional equations (4.13). This decision gives the lift 
number after which service should be terminated for the receiver in progress, ja; 
(f) The optimization over all possible partitions of receivers between two servers, 


designated a and b, can be written as 


f(P*) = max [| f*(s' U Va}) + fener s’ U (7b}) | - (4.14) 


sve S, 


If ja is not null, then re {1,.... R’ +1}. Ifja is null, then re {0,..., R’}. When either 
ja or jb is null, define /(,*(0) =0. 


Discussion. Equation (4.11) follows directly from Proposition 4.2. Equations 
(4.12) and (4.13) are specializations of Equation (4.8) in Proposition 4.2 which consider, 
respectively, states which exclude or include a receiver in progress. Equation (4.12), the 
case where receivers 1n progress are excluded, 1s a direct application of Equation (4.8), 
where s’ replaces s. Equation (4.13), the case where receivers in progress are included, 
is an adaptation of Proposition 4.1 in which the order of receivers was specified. This 
follows because when considering a state which includes the receiver in progress, any 
continuing service to that receiver follows immediately before any service to the re- 
maining receivers. In Equation (4.13) the decision variable k, which gives the total 
number of lifts allocated to that receiver, is limited to take on values from /, to 7,,, since 
the receiver in progress, ja, has lift number /, in progress. Equation (4.14) is a special- 


ization of Proposition 4.3 where the partition of receivers between the two servers is 
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limited due to the receiver(s) in progress being constrained to continue service from the 


corresponding server. 


Example 4.3 (continued). To show how the induction would proceed, Equations 


(4.11) through (4.14) would be expanded as follows: 


fi*C) = Vin) 
f,*(2) = Vo(n)) 
f\*(4) = Vala) 
fi*(5) = Vs(rs5) 
an. LM) + F(x(k) A*(4)] 
fy*(1,4) = max max [VK + Fee) £2] 


f(1,2) = _max | P(k) + FRC) AX) | 


= oesy No 


ee) = pax | P(k) + Fe 0) f,"(4) | 


eer, 


ACLS) =, max [ VW) + FR) 2) 


f2(4,5) = max (PAK) + FR) £4) 


iol tig 


AC, 4,2) = pax | V(k) + F(2,(K) A*(1,4) | 


eres 


@oor,s 


fy*(1,4,5) =, max [¥s(0) + F(S() 4*(1,4) | 


fy*(1,4,2) + fi*(S) 
Fy*(1,2) + 24,9) 
fy*(4,2) + fo*(1,9) 
f,*(2) + A*(4,5) 


fe) = ina 
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When there are no receivers in progress (1.e., jo and js both null), then 
S” = {0}, R°=0, and Proposition 4.4 reduces to Propositions 4.2 and 4.3 for the re- 


ceivers who have not Vet started service. 


2. Interrupting a Receiver in Progress and Rescheduling 
In this section, the assumption that each receiver gets at most one opportunity 
alongside the delivery ship (Assumption 4.1) is relaxed to permit the service to a receiver 
in progress to be interrupted, and to allow all receivers’ unfilled requests to be considered 


for additional service following the interruption. 


Assumption 4.7: When a schedule is revised, independent of past service, and 
service in progress, each receiver gets at most one future opportunity alongside the de- 


livery ship. 


The simple revision considered in the previous section is a special case of revision with 
interruption and rescheduling in two respects. Firstly, in simple revision, receivers who 
previously completed service were not considered eligible for additional service. And 
secondly, because simple revision can be thought of as interrupting a receiver in 
progress, and rescheduling it for additional service constrained to commence imme- 
diatelv. In order to generalize the second idea and allow the additional service to com- 
mence after some intervening service to other receivers, any effect that the interruption 
delay has on transfer and strikedown completion times must be considered. For an ini- 


tial approach to this problem, a simplifying assumption will be made. 


Assumption 4.8: The receiver processing times c{/) — x( do not depend on the 


sequence in which lifts are transferred or on the time of transfer. 


In the context of this problem, for Assumption 4.8 to be valid, strikedown queues can 
not develop, and, consequently, any interruption delay will not affect strikedown com- 
pletion times. In contrast to this, if strikedown queues did develop, the receiver proc- 
essing times would include waiting time in the strikedown queue. Then an interruption 
delay would allow the strikedown queue to shorten (or empty), and hence reduce the 
receiver processing times following a delay. Furthermore, the amount by which the 


strikedown times are shortened would depend on the length of the delay, which would 


a Sl ee a 


not be not known until after rescheduling is finished. The problem with strikedown 
queues 1s left for future work. 

Returning to the idea that simple revision can be thought of as interrupting the 
receiver in progress, and rescheduling it for additional service constrained to commence 
immediately, the formulation of the current problem of revision with interruption and 


rescheduling will use the following conceptualization: 


¢ Any receivers in progress are interrupted as soon as the lift in the process 
of being transferred is completed; 

e The remaining lifts requested are considered for rescheduling ; 

¢ If after rescheduling, the additional service follows intervening receivers, or 
is shifted to another server, then the transfer time for the first additional 
job will typically include some additional setup time. 

- If, however, the additional service commences immediately with the same 
server (as in the case of simple revision), then no additional setup time will 
be incurred. 


Example 4.4. Suppose there are a total of R =3 receivers, and receivers 2 and 
3 are in progress at the delivery ship’s port and starboard sides, respectively, and receiver 
1 is ready to start service. Since the schedule is now to be revised, it is immaterial for 
which side receiver 1 had been previously scheduled, and immaterial whether or not re- 
ceiver 1 had received previous service. A possible revised receiver sequence for both 


sides 1S: 


Port side: Receiver 2 (without additional setup time), 
followed by 
Receiver 3 (with additional setup time). 


Starboard side: Receiver 1. 
Another possible revised receiver sequence for both sides 1s: 
Port side: Receiver 1, followed by 


Receiver 2 (with additional setup time). 


Starboard side: Receiver 3 (swihour additional setup time). 
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The inclusion or exclusion of additional setup time can be thought of as distinct 
initial conditions depending on when additional service for a receiver in progress com- 
mences. To accommodate this, each receiver in progress will be represented by a pair 
of alternative pseudo-receivers, each with a unique sequence of transfer completion and 
strikedown times that reflect the appropriate initial condition. As before, let ja denote 
the identity of the receiver in progress at server a. If the additional service for this re- 
ceiver in progress is allowed to commence immediately with the same server, then ja will 
be represented as the pseudo-receiver ja, Otherwise, if the additional service for this 
receiver in progress is required to follow intervening receivers, or shifted to another 
server, then ja will be represented as the pseudo-receiver ja,. The pair ja, and ja, are 
called alternative pseudo-receivers since any revised schedule will include one or the 
other. If referring to additional service regardless of when it commences, the alternative 


pseudo-receivers will be coilectively denoted 
Ja, = Yay Qjay) | 


Where the © symbol is the logical exclusive or operator, which in this context may be 


read as either ja, or ja, but not both. 


Example 4.4 (continued). In a manner similar to Example 4.3, receivers in 
progress at the port and starboard sides of the delivery ship are denoted jp and js, re- 
spectively. Considering alternative initial conditions for remaining service, the receiver 
in progress on the port side, jp , will be represented as either the pseudo-receiver jp), the 
pseudo-receiver jp,, or collectively as jp,. Similarly, js will be represented as either the 
pseudo-receiver js,, the pseudo-receiver js,, or collectively as js, . In this example, jp = 2 
and js = 3. Numerical examples for jp , Jp, JS. JS, Jp. , and js, will be given following 


some additional discussion. 


For all receivers, let 2, denote the number of remaining lifts requested by receiver 

j. In terms of given data and the observed process up to the revision time, 7, is equal to 

the original number of lifts requested, ”,, minus lifts in progress and lifts previously de- 

livered. In particular, the number of remaining lifts requested by receiver j are as fol- 
lows: 

- If receiver j has not yet started any service, then 7, = 2, , the original number 


of lifts requested; 


- If the receiver in progress is denoted ja, and I, denotes the index number of 
the lift in the process of being transferred, then 7,,=n,, — 1; 

- And if receiver j has already completed previously scheduled service, and the 
decision variable k, denotes the number of lifts previously delivered to re- 
ceiver j, then n,=1n,— k,. 

Let the index / and the decision variable k now denote lifts in addition to lifts 
in progress and lifts previously delivered. In particular, let the index / define the fixed 
sequence in which remaining lifts are transferred to each receiver; /= 1, ... , n,; and let the 
decision variable k, denote the number of additional lifts to deliver to receiver /; 
k, € {0,1,...,%} . It should be noted that this use of indices for receivers in progress is 
a departure from the use in the previous section describing simple revision. In that spe- 
cial case, the original number of requests, ”, and original indexing of lifts, /=1,...,7, 
were used; and the number of lifts to deliver to the receiver in progress was simply re- 
vised, where the possible revised values were k,, € {/, ...,,,} . In the more general case 
of revision with rescheduling, where for a receiver in progress , =n,, — /,, then the in- 
dexing of lifts and possible values of the decision variable are shifted back to their re- 
spective origins. It should be further noted that under this revised indexing of lifts, the 
nature (type of anmmunition) of the / lift will, in general, be different than under the 
Original indexing. Consequently, the transfer completion times, x,/), strikedown com- 
pletion times, c(/), and the marginal combat values, v(/) will have revised given values 
based on the current identity of the / lift. 

For all receivers not in progress (1.e., j # ja), and for receivers in progress who 
may get rescheduled following some intervening service (1.e., / =/a,), the original defl- 
nitions of transfer and strikedown completion times apply to remaining service (even if 
the values are revised). This includes the provision that x(1), the time it takes to transfer 
the first remaining lift, tvpically includes setup time. In contrast to this, for a receiver 
in progress who may get rescheduled to commence additional service immediately (1.e., 
Ad, and Ciao 


pletion times that exclude setup time. 


j =ja), define x, (J), respectively, as transfer completion and strikedown com- 

Now, considering the nature of transfer and strikedown completion times, a 
convention may be adopted to assign numerical value for jpo, jp,, JS) , and js,. Since the 
nature of transfer and strikedown completion times for ja, are the same as the original 
transfer and strikedown times for ja, it is convenient to re-use the receiver index by set- 
ting ja, = ja. However, since the nature of transfer and strikedown completion times for 


jd) exclude setup time, distinguishing indices should be used for these special pseudo- 


receivers. Since there are A receivers, it is convenient to set js=R+1, and 


J~pp= R+2. 


Example 4.4 (continued). In this example, set 


Jp; =jp =2 
js; =js = 3 
And since R = 3, set 
JSo = 
JPo = 5 


Using the collective notation, 


Jp. = (ipo@p;) = (2@5) 
JS. = YS Qis;) = 3O4) 


It will be convenient to use additional notation to represent some special states. 
With the convention of using original index numbers for all ja,, let S° denote the set of 
receivers and or pseudo-receivers identified by their orginal index je {1,..., R} ; and let 
s° denote anv subset of S°. Thus s° is a state that excludes all ja, but may include any 
ja,. Also let S’ denote the set of receivers who are not currently being served; and let s’ 
denote any subset of S’. Thus s’ is a state that excludes all ja, and ja,. If there are not 
receivers other than those in progress, then S’ is the null set. These special states are 
adaptations of what was called an intermediate state in the previous section describing 
simple revision. In all cases, these special states consist of receivers who are to be 
scheduled for service which is not constrained to commence immediately. In the previ- 
ous case of simple revision, s’ could contain only receivers who had not vet started ser- 
vice, Which were all remaining receivers other than those in progress. In the current case 
of interruption and rescheduling, s’ is redefined, slightly, as a state which could contain 
all receivers other than those in progress, regardless of whether or not they received prior 
service; and s° is defined as a state which could contain all receivers other than those in 
progress, regardless of whether or not they received prior service, as well as the pseudo- 


receivers ja, who are not constrained to commence service immediately. 
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Example 4.4 (continued). In this example. the set of receivers and/or pseudo- 
receivers identified by their original index are 


Slee) 


and the possible original-index states, including a null state are 


5 GMO}, (m2 ais, {1-399N1253) , (1,2,3) ae 
Also, the set of receivers who are not currently being served is 
Sé= {1} ; 
and the possible woz-in-progress states, including a null state are 
2 nO Oe me 


Functional equations can now be written to find the optimal schedule revision 
when service in progress is interrupted and all receivers’ unfilled requests are considered 


for additional service following the interruption. 


Proposition 4.5: Under Assumpuons 4.2 through 4.8, 
(a) The maximum expected combat value with 1 receiver remaining to be served, 


iS 
fi'G) =V in); (4.15) 


for all j: 

(b) For all original-index states s°, the maximum expected combat value with 
r+ 1 receivers remaining to be served, where the identities of the r+ 1 receivers are the 
elements of the set s°, 1s 


Sri“(S°) = max max [ V(k) + F(x(&) fas\)] | (4.16) 


JES | kas0,1,..., 7, 


fomemleswess..,, and fory=1,..., R — 2; 
(c) For server a, for particular original-index states s° such that ja, ¢ s°, the 
maximum expected combat value with r + 1 receivers remaining to be served, where the 


identities of the r receivers other than ja, are the elements of the set s°, 1s 
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farts? U Ya}) = max [ f4,%(s°U Ga)), FS UVa) ] 3 417 
where 


fay*(s° U Yag}) = wat WAGES SCO || (4.18) 


and 


fal Ue) = max | max Paes F(x(k)) G*(Uiag} U s ww) (4.19) 


J # JQ, k=0,1 


for all s° such that s° e S, and ja, ¢ s°; and forr=1,...,R—1; 

(d) The optimal decisions for each state at each stage are the arguments which 
maximize the functional equations (4.16) through (4.19). These decisions give the iden- 
tity of the optimal receiver to schedule for service in that state at that stage, and the 
corresponding optimal number of lifts allotted to that receiver; 

(e) For all not-in-progress states s’, the optimization over all possible partitions 


of receivers between two servers, designated a and b, can be written as 


[ Fat CG) Ol en ees Gm 
‘ Ba CU mee Fea O Ue) | 
f(P*) = max a 
ae Weg te OT) aaa ere aos U Ya;}) }) | 
LAM) + fr_+*(s’ U Yib.} U Viay}) | 


(4.20) 


c 


where f,*(0) =0 


Discussion. Equations (4.15) and (4.16) follow directly from Equations (4.11) 
and (4.12) in Proposition 4.4, with n, replacing n,, and s° replacing s’. The original-index 
states in Equation (4.16) may be intermediate states for any server. However, since 
pseudo-receiver ja, mav be served first in any of these stages, these original-index states 
may be final states only for a server other than server a. Consequently, Equation (4.16) 
enters the recursion through the next to the last stage (i.e., to obtain f,.,*(s°) ). 
Equations (4.17), (4.18), and (4.19) collectively give the maximum expected value for 
final states for each server in which that server either serves the pseudo-receiver ja, who 
iS COnSstrained to commence service immediately, or serves the pseudo-receiver ja, who 


1s Constrained to commence service following some intervening receiver. Equation 
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(4.18), which follows directly from Equation (4.13) in Proposition 4.4, gives the maxi- 
mum expected value for the final state which includes the pseudo-receiver ja, who is 
constrained to commence service immediately. Equation (4.19) is a specialization of 
Equation (4.16) in which the possibility of the pseudo-receiver ja, getting service in that 
stage 1s precluded (1.e., the outer maximization in Equation (4.19) is over j #/a,). The 
superscript a on f,?,(s° LJ {ya,}) 1s used to distinguish the server and the corresponding 
pseudo-receiver ja, who 1s precluded from immediate service. It may be noted (and ex- 
ploited in implementation) that except for the final stage, and except for the precluded 
ordering, the computation on the right hand side of Equation (4.19) is obtainable from 
Equation (4.16). Equation (4.20) is a specialization of Proposition 4.3 where the parti- 
tion of receivers and pseudo-receivers between the two servers is characterized bv three 
special cases. (Four cases are used in Equation (4.20), but the fourth is simply a sym- 
metric version of the first.) The first (or fourth) special case is where one server provides 
subsequent service to both the receiver who was in progress with this server and the re- 
ceiver who Was in progress with the other server: and the other server provides subse- 
quent service to only receivers who were not in progress. The second special case 1s 
where both servers provide subsequent service to the receiver who was in progress with 
that server. And the third special case is where both servers provide subsequent service 


to the receiver who was in progress with the opposite server. 


Example 4.4 (continued). To show how the induction would proceed, Equations 
(4.15) through (4.20) would be expanded as follows: 


First Stage (Eq. 4.15): 


(dey); V4(m,) 
fFQ) = V(%) 
f,*(3) = V3(%) 
fi*(4) ae V,(774) 
io a 


Second Stage (Eq. (4.16)): 
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max Fa Fa) een 


k=0,1 


f*(1,2) = max P man Ltt) + Foute) £20) 
=0,1, ..., 2 


max [V,(k) + F(x,(k)) A*(3)] 


k=(,!, ooey My 


f*(1,3) = max _max [¥(k) + Fea) £20)] 


aes [ Vo(k) + F(x,(k)) xe 


ree Tho + ECO) MeL 


tn (2.5) ae ax 


Second Stage (Eq. (4.17) - (4.19)): 


Starboard Server: 


(Eq. (4.18)): 
APA = max [V(k) + FealA) AP] 
f°(2.4) = max [Valk) + Fea(A) A*2)] 
(Eq. (4.19)): 
Ai(3) = max [M4(k) + Foal) A*Q)] 
f'23) = max LV) + FOa®) fi*@)] 
(Eq. (4.17)): 


fF U,.CO2i=) maxed 46 ol 
f*(2,3@4)) = maxlf,*(2,4), 4°(2,3)] 


Port Server: 
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(Eq. (4.18)): 


AMS) = max [Vs(k) + Flxs(k)) £*0)] 


A*(35) = _ max [V5(k) + FOs(h) A(3) ] 


(Eq. (4.19)): 
f,P(1,2) = max [V(4) + FO(4) A*(2) | 
f'G,2) = max L¥3(k) + FOs(k) A*2)] 
(ee, (4:1 /)): 


A*(1(2@5)) = max A*(1,5), A"(1,2)] 


i (cca) amesben(GSleas Cail 


Third Stage (Eq. (4.17) - (4.19)): 
Starboard Server: 


(Eq. (4.18)): 


A 


n 


A*(124) = max [ Valk) + FOa(K)) 44.2) ] 


(Eq. (4.19)): 
ae i [ V1(k) ae F(x,(4)) Geol 


fy°(1,2,3) = max max [¥a(K) + Fea) 4°(13)] 
=0,1,..., M 


(Ea.(4.17/)): 


A (1, 2,3@4)) = max[f*(1,2,4), Leen 


Port Server: 


7\ 


(Eq. (4.18)): 


Ay*(,3,5) = max [V5(4) + F(xs(k)) 4*(1,3) ] 
k=0,1, ..., Me 


(Eq. (4.19)): 
_max [ V,(k) + F(x,(A)) 4*(2,3) ] 
p >) = U,1, woe, My _ 
fee) SMA) max [Ys(k) + Flatt) £21.2)] 


(Eq. (4.17)): 
f;70, 3.(.2@5)) =" max (ys se (lee 
Partition (Eq. (4.20)): 


f*(1, 3,25) 
fy™(L(2@39)) + fy") 
Ay"(3.205)) + fi") 
fy™(1,3) + fr*(2) 
Ai*(3) + A*U,.BO4)) 
AP) + A*(2.G04)) 
Ai*(3) + f2*U,2) 
A", 2,3@4)) 


f(P*) = max 


Further work with the combat CONREP problem, and its interaction with the 
combat VERTREP problem 1s discussed in the conclusions. 


V. COMBAT SUPPORT LOGISTICS: SERVICE POLICIES WITH 
QUEUE LENGTH INFLUENCE 


A. INTRODUCTION 

A logistics problem faced by an operational unit, such as a deployed detachment of 
aircraft, involves setting a maintenance policy for organizational level repair of 
mussion-essential components. For full combat mission capability, an aircraft must have 
several different major avionics components available. Let the index i identify each of 
the different types of components required; ;=1,...,/. An aircraft squadron or 
detachment deploys with A, units of each assembly (including installed components plus 
spares), and has a maintenance shop to perform basic service'repair of components 
when required. Each item has Markovian failures at rate /,, and expected time to repair 
of v-!. Service times are assumed to be independent and exponentially distributed. The 
arrival rate of each tvpe of failed item as seen at the maintenance shop will be the indi- 
vidual item failure rate multiplied by the number of items operating at that time. In 
modeling the aircraft detachment problem, the number of items operating is the number 
of operational aircraft available. Before considering the aircraft detachment problem 
directly, a repairman model is considered in which the number of items operating is 
taken to be the number of items available. 1.e., the original population of that item minus 
the number awaiting repair and or being repaired at that time. 

The primary objective of this study is to develop analytic models to analyze the 
transient behavior of the system based on the effects of a service discipline which 1s in- 
fluenced by the numbers of each item awaiting repair. It is especially important in 
combat support logistics to be able to analyze transient behavior, since, due to changes 
in combat intensity, a steady-state may never be reached. Besides looking for the mean 
number of items in the system as a function of time, it is desirable to get a solution for 
the variances as well. Knowledge of both the mean and variance will allow measures 
of effectiveness to be calculated which consider, for example, the probability that the 
number of items available exceeds some threshold. The ultimate application is to assess 
the adequacy of logistic support on the availability of an operational unit, where that 


support includes both spares and a single repair facility, e.g., a complex test and repair 
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stand. Previous work on this problem was done by Latta [Ref. 27 ], who used simu- 


lation to compare several maintenance policies. 


In the repair situation, since it is costly in time to switch from job to job before 
completion, the service disciplines of interest relate to how the next item 1s selected to 
commence service, af the epoch of a previous service completion. This type of repair ser- 
vice discipline is clearly different from a time-sharing discipline used in some computer 
systems and communications networks. However, a service discipline approximation 
used for time-shared systems provides a convenient step towards the analysis of the re- 
pair situation. 

Processor-sharing is a modeling approximation to the time-sharing discipline. The 
approach taken in this thesis is to adapt the heavy traffic diffusion analysis of 
processor-shared systems to study the repair situation in which the next item selected to 
get service, upon completion of a previous repair, is chosen based on the numbers of 
each item awaiting service. Specifically, the following is an outline of the development 


of this chapter: 


(1) In Section B., a diffusion approximation is developed for a repairman model 
in heavy traffic, with processor-sharing, multiple types of queues, and service priority 
proportional to a function of queue length. 

(2) In Section C., a renewal theorv approach is used to adapt the model from 
processor-sharing to the repair situation in which each job is completed before the next 
Job is selected for service. 

(3) Sections D. and E. present several numerical examples and an application of 
the model. 

(4) In Section F., the model is extended to general service time distributions. 

(5) In Section G., the repairman model is adapted to the aircraft detachment 
repairman problem. 


B. A PROCESSOR-SHARING REPAIRMAN MODEL WITH MULTIPLE TYPES 
OF JOBS AND PRIORITY SERVICE 

Let \ (1) denote the number of items of type i that are awaiting repair and/or being 
repaired at time J; collectively denoted by the vector N(z) = [.\,(0), V,(a), ... , N(0). 
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An item of type i has Markovian failures at rate J, , and in this repairman model, 
the arrival of failed items is proportional to the original population of that item minus 
the number awaiting repair and/or being repaired at that time. Hence, the time- 
dependent arrival rate of each type of failed item as seen by the repairman is 
A,(K,— N(1)), for (= 1,..., 7. The probability that a failed item of type / arrives at the 
repair shop in the interval (t, 1+ dt) is 4,(K,— N(2)) dt + o(dt). 

In processor-sharing, each of the jobs of type / in the svstem at time 7 receive a 
proportion, g(N(z)), of the processing provided by the server in each interval (1, 1 + a1). 
In the traditional processor-sharing model the proportion of service each job of type i 
receives 1s identical to the proportion of jobs of that type in the system, i.e., each job 
present is given equal weight, and ¢,(N(z)) is defined by: 
aN) = 


YG 


/ 


An equivalent view of processor-sharing is that the server completes infinitesimal 
time slices (length dz, di -— 0) from a job and then switches to another job (a job of tvpe 
i) at the end of such a she with probability g(N(1)) , so only rarely is a job completed 
and then followed by a jump to a new job. This latter view of g(N(z)) as the probability 
that a job of type / starts (a slice of) service is taken here, so as to set up the processor- 
sharing model of this section for adaptation to the real repair situation in Section C. 

In this processor-sharing model, for a job with an exponentially distributed service 
time, with mean 1/¥,, the probability that it completes service in the interval (1, 1: + dr) 
is v,g{N(r)) at + o(dr). Several papers have reported results using processor-sharing 
models. See, for example, Coffman, Muntz and Trotter [Ref. 28], Mitra [Ref 29], and 
Gaver and Jacobs [Ref. 30]. 

If the service mechanism is processor-sharing, then {N(z); > 0} is a Markov process 
in continuous time. If J= 1 then this is identical to the classical single-item repairman 
problem; see Feller [Ref. 31, p. 462] and Gaver and Jacobs [Ref. 30]. 

Heavy traffic conditions can allow the use of a diffusion approximation to study the 
time-dependent behavior of the system. Consider the classical single repairman problem 
with individual machine failure rate 4, service rate v, and K total machines. And let 
N(t) be the number of machines that have failed and are awaiting repair or being re- 


paired at time z. Ielehart {Ref. 32] has shown that when heavy traffic conditions prevail, 
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i.e., large K and AK/v > 1, N(¢) may be approximated by the Ornstein-Uhlenbeck proc- 
ess, hence the diffusion approximation. Several papers have reported models extending 
diffusion approximations to multivariate birth and death Markov processes, also known 
as Markov population processes. See for example McNeil and Schach [Ref. 33], Gaver 
and Lehoczky [Ref. 34], Gaver and Lehoczky [Ref. 35], and Gaver and Jacobs [Ref. 30]. 


1. Diffusion Approximation 
Following the arguments in Gaver and Lehoczky [Ref. 35], the following system 


of stochastic differential equations are written directly: 


dN(t) = 4; (K)— Nid) dt — v; g(N(O) 


7. (K = N{)) + ¥, g(N() OD 
+ 4; (K;— Nt) + vy q(N(Q) aA%(2), 
for i=1,..., 7; where {IV/{1);12>0} are independent standard Wiener processes, 1e., 


(0) =0; {1’(2);1>0} has stationary and independent increments; and for all 1>0 
H’(t) is normally distributed with mean zero and variance t. Here, N(t) is a continuous 
approximation to the actual jump process. The notation d\{z) is used to represent the 
increment .V(i+ dr) — N(t). See Karlin and Tavlor [Ref. 36] for a systematic develop- 
ment and other examples. 

The derivation of Equation (5.1) is as follows. The da terms represent the 
infinitesimal drift of .\V(z) from 2 to t+ dz, and the dl¥’(2) term is the stochastic increment 
to the process occurring in (1, 1+ a1). The form of these terms is obtained from the 
observation that arrivals and departures act as independent Poisson processes in short 
time periods. The arrival rate is proportional to the number of remaining items of type 
i. Departures occur at rate v, if an item of type i 1S in service at time 7, and, under 
processor-sharing, the probability ¢(N(z)) represents the proportional amount of service 
that an item of tvpe j receives in the interval (1, :+ dr). Then, since the variance of the 
Poisson equals the mean, and for large parameter values (large K,, in this case), the 
Poisson is approximately Gaussian, this heuristically justifies the coefficient of the 
Weiner process differenual. 

Now let a= 3K, the total population of components, and consider the follow- 


. ° 4 
ing normalized process: 


N{t) — amt) 


4A; (1) a Ja ’ 
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OF 
Nit) = amr) t+ Ja xf(9 , (5.2) 


Where ms) are deterministic functions, being approximations to the process means 
scaled by a; and A¥(s) are stochastic elements (random disturbances or noises superim- 
posed upon the deterministic approximations to the means). Such a transformation has 
been used , for example, by McNeil and Schach [Ref. 33], and Gaver and Lehoczky [Ref. 
34 ]. 


The increment in \V(z) in (t, t+ df) is expressed as 
dN{t)=admt)+ JadX;(1) . (553) 


Substituting (5.2) and (5.3) into Equation (5.1) (except, for now, in the g(N(z)) term) 
gives 


adm(t)+ Ja dX7(t) = 4, (K; -—a m1) — ya XF(2)) dt — v; q(N(0) dt 


+ (5.4) 
a ; ra 
+4, (Kj -am() — Ya XF(0) +, 9(N(Q) diV(d) 

The properties of the deterministic and stochastic elements, m(r) and X%(1) re- 
spectively, as a— co can now be determined. In order to do this, it is necessary to scale 
the number of components for each item, K, , expressing these parameters as a fraction 
Sieaeeeet hk, —%,a. Similarly, let the service rate vy, = x, a. Substituting for K, and v,, and 


dividing through by a, (5.4) becomes 








dm{t) + se AX}(t) = 4; (a, — m4) - = x70) dt — pn; 9{N(t)) dt 
va | 


(5.5) 








+ = is(a)— m(o)- — X70) + g({N(a)) dla). 
a 


The strategy to obtain an analytic solution to these stochastic differential equations 1s 
to isolate terms of order 1 and order 1/,/a yielding a system of ordinary differential 
equations for the deterministic means, and a system of stochastic differential equations 
which can be solved to obtain the properties of the noise terms. 

It remains to express g(N(z)) as a function of m(zr) and Xz), when ¢(N(z)) 1s 
modeled in a useful and sufficiently smooth (1.e., differentiable) form. For example, if 


g(N(z)) is defined as in the traditional processor-sharing model, then the service priority 


ql 


rule would be to randomly select the item to receive the next slice of service with prob- 
ability proportional to the number of that item awaiting service. Thus ¢,(N(z)) would 


be expressed as: 


yy 

J 

a mit) a Ja X(t) 
ya mit) + fa X70) 


j 


The strategy for obtaining an appropriate analytic solution only requires terms 
of order 1 and order 1/,/a. Thus, it is sufficient to derive a first-order asymptotic ex- 
pansion for g(N(z)) in powers of 1/,/a. Rather than limit this development to the ex- 
pansion of a very specific example of g(N(t)), a more general form is considered. 


2. Service Priority Proportional to a Smooth Function of Queue Length 
A fairly general form for ¢(N(z)) that can be useful for modeling various service 
policies, and the corresponding expansion to terms of order 1/,./a, is given in the fol- 


lowing proposition. 


Proposition 5.1: If ¢(N(z)) is of the form 


Ww; [b, + C; NA)’ 


5 [b; + ¢ Ni(2))” 


j 


q(N(x) = 


where w,20, 6=af8, £, finite, c, and y are arbitrary constants, and where .V(z) 1s re- 
presented by the transformation 


Nt) = am) t+ JaXf(n) , 


then an expansion to terms of order 1/,/a, is given by 





A ] ¥ G; A py 
a(N() = G(en()] 1+ (x 0S ) Gen wig) (5.6) 
Jt 
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where 


Ww, [B; + ¢, m{0)]’ 


q(m(z)) = 
ar [By + cy my’ 
j 
Proof: As defined 
a i y 
g(N()) = ee MOT 6.7 
Wy [5; + C) NA{1)}" 
] 


Use the representation 
N() = amy + Ja Xo, 


and Iet 6 =af, Then (5.7) becomes 


By oe ee le 
> [apB,;+camntc va x7 (0) 


H] 
w; [B; + c; mt) + — eX, (ry). 
Va 
] ’ 
> 6 1B; +o my) + = 6 HHP 
V/ 


y 


(5.8) 


Let this last representation be denoted g,{m(t) + (1/Ja )X*(z)) , Where the caret 1s used to 
reflect the modification of the original g, which included the scaling of the constant 8, 
and the division of numerator and denomunator by a’. Now, fix ¢ and treat 


q.{m(2) ar (1/ya )X°(s)) as a function of (1/./a ) alone to obtain an expansion. For brev- 





ity tet 
ol 
) = Ja ’ 
Fld) = wi [Bet qmo+ eo X (OV , (ee) 
and 


gid) = Jig) (5.10) 
Die) 


The expansion of g({@) 1s 


gO) 


EAP) = SAU) eee (5.11) 


From (5.10) 








dg) 1 afi?) Si) d 
1 Mid 9 _ 4 (Sy) 











dp dp 
Df@) (So) 
(5.12) 
agen sft “110 ) Shy ld) 
> filo) | Df ae 
ke 
Prom (522)) 
df; = 
-— = w{B, + o m1) + bo XPOP~ ) (4 X7 (0) 
=wW Y GAD 
= w{B) + o mr) + o ¢; XF()] Btam+ocqA%0 (5.13) 
ye y  XF(0) 
=i B, +c, m(t) + 6 co, A7(2) 
Substituting (5.13) into (5.12) 
dgio) _ _ Sd¢) yo Xr (2) Z Ds S{?) yo X(t) 
dp >» filo) By + cp mit) + b oj X; (0) - dfuo) Bj + cj mt) + bo X;(1) 
k 
= g(¢) meh 4 ACO (5.14) 


Bramin+eqay  °? dai?) Bprem+de Xo 


__ 7s GY al 
- 20) ( B; Ee C, ni(t) af o C; MG (1) Da(@) By + CG mt) + p c, X7 (1) : 
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Evaluating (5.14) at 6 = 0 


dg (0) sail YC; XF (1) 7g A) _ X7 (1) 
dp - 40 ( Fase Tc, ~ 28/0) B+ 6 mia) ee (5.15) 


Substituting (5.15) into (5.11) 


ee 7 4 X7(0) y 6; X7 (0) 
8d) = 8:(0) [ +o( VETS) 280 al +o(p) . (5.16) 


Recalling that ¢ = (1/,/a ), and 





fe US ue eH) cp een Dr eale 


yg 
> [Bj tom (0) += 4 x) 5.17 


i 


= i mio i = x) | 
then 


wv; [B, + ¢; md) 
> [B; + Gg m(Oy (5.18) 


J 
= g(an(1)) ’ 


g(0) = 


and the result is obtained. « 
Specializations of the general form of g(N(z)) given in Proposition 5.1 will be 


introduced in Section C. 


3. Diffusion Approximation (continued) 
Returning now to the stochastic differential equations, substituting (5.6) into 
(5.5) and isolating terms of order 1 and 1/,/a, the following sets of equations are ob- 
tained. 
Equations of Order 1. The equations of order 1 form the following system of 


ordinary differential equations: 


8] 


amt) = 4; (a; — m1) at — y; q,(m(z)) at | (5.19) 


for i=1,..., /. With given initial conditions, a solution can be obtained by numerical 
methods, which provides a deterministic approximation to the scaled mean queue lengths 
as a function of time. 

Equations of Order 1{./a . The equations of order 1 |/a form the following sys- 
tem of stochastic differential equations: 


y ¢; 


aX; (0) = A ay 


gdm(s)) (1 — 9m(z))) X7 (0) at 
ae A A ra 
+ Hy; enn q(m(t)) ¢(m(z)) Aj (2) de (5.20) 
j#i 


+ JA; (0; — md) + Hj G(m(d) a0); 


fone — lee 

It is noted that the effect of boundaries on the evolution of the system has not 
been included. In the deterministic equations (5.19), inclusion would constrain all mz) 
and their sum to be within [0,1]. A heavy traffic condition will imply that, with high 
probability, the system will evolve away from the boundary at zero and return very 
rarely. Such a condition may be derived from (5.19). As mr) — 0 its derivative must 


become strictly positive to move m(r) away from zero. Thus 


4 A 


A, a;- nj9{0°) >0 , (9.21) 


Or 


: 
Fp 2 


we (5.21) 
fori=1,...,/. Since, 0 < g(0-) < 1, for all i, the following sufficient heavy traffic condi- 
tion, hereafter HTC, is suggested: 


A; 


a : (5.22) 


fori=1,..., 7. HTC is clearly stronger than required. Since the g{0*) sum to 1, it should 
not be necessary for (5.22) to be satisfied simultaneously for all i. The necessary heavy 


traffic condition may be obtained by summing (5.21) over all i. This gives 


Or 





A, 0 
» ui; =. (S923) 


This will be referred to as an aggregated heavy traffic condition (AHTC). 
The upper boundary is implicitly enforced by the (a, — m(z)) coefficient of the 


arrival rates. The stochastic equation (5.20) are only valid for 
— amit) < X71) <Ja(o,— min) , 
so that for 0 < mt) <,, the boundary can be ignored as a— oo. For these models, it 
is assumed that the AHTC holds. 
4. Solution of the Stochastic Differential Equations 
To write (5.20) in matrix form, let 
X(t) 


ae t) = An I ) 


X(t) 


and 


Wi(d) 
(2) 


WA) 


Then (5.20) becomes 


dX7(t) = H(t) X°(d) dt + B() dW(2) ; (5.24) 


where H is an / x / matrix with elements 
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YC; 


H(t) = — 4: — B; eras) q(m(z)) (1 — 9(m(d))) , 
and 
y C A A 
A(t) = p, Btom() qxm(z)) q{m(z)) 


for i#/; B(s) is an 7 x J diagonal matrix with elements 
Bilt) = VJ 4; (aj — mt) + wy q{m(z)) ; 


and with initial conditions, X7(0) = 0. 
If m(zr) satisfies (5.19) then the results of Kurtz [Ref. 37 ] and Barbour [Ref. 38] 
imply as a— oo that {X*(z); > 0} will converge weakly to {X(z); = 0}, governed by the 


stochastic differential equation 
aX(t) = H(t) X(2) dr + BUX) dW(z) . (Sas) 


Gaver and Jacobs [Ref. 30, Appendix] outline the mathematical foundation upon which 
the diffusion approximation of this chapter may be rigorously based. 

Equation (5.25) characterizes an Ornstein-Uhlenbeck process, for which several 
results are given by Arnold [Ref. 39, p.143]. Specifically, X(z) has a multivariate normal 
distribution with mean 0 and variance-covariance matrix V(z) which satisfies the follow- 


ing svstem of ordinary differential equations: 


dV (1) 
dt 





= H(z) Vi) + V(t) H’'( + BOD B'(d) .. (S126) 


Recalling that 
N(t) = am(s)+ Ja Xs) , 
the following result has been obtained: 
Result 5.1: Under heavy traffic conditions (3/7, K,/v, > 1), for a large system 


(a> co, a=>K, where all K,7 © simultaneously and in fixed proportion), N(z) is 


multivariate normal (Gaussian) with mean a m(t) and variance-covariance matrix a V(1). 
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From this result it is possible to obtain estimates of the mean and variance of 
time-dependent queue lengths that result from adoption of a particular service policy 
modeled by the function g(N(z)). 

Solutions to the systems of ordinary differential equations (5.19) and (5.25) can 
be obtained by straightforward numerical methods. Writing 


O1;(1) a4 2(2) wes 01) 
V(t) = 02,(t) Gaal’) aie (2) 
HOW oO a6 


and making the required substitutions and multiplications, differential equations for the 
elements of V(r) are 





do;, 
ae = (BUOY +2 2 (840) a(t) ; (5.27) 
and 
d ii(0) 
- - Your (H(t) a(t) + CAC) ox(9)] | (5.28) 
for i #/. 


C. DYNAMIC-SERVICE-SELECTION: THE NATURAL ALTERNATIVE TO 
PROCESSOR-SHARING 


An alternative to the processor-sharing model represented by Equation (5.1) can be 
developed with a renewal theory approach to the service completion process. This al- 
ternative model reflects that the service to another item can only commence when a 
previous repair 1s completed, where the item to receive the next service is selected prob- 
abilistically. This discipline will be referred to as dynamic-service-selection (DSS). 

As in the previous processor-sharing model, the functional form of the probabilities 
used to select the next item for service is chosen so as to model priority for service as a 
function of queue length. The general form for ¢g(N(s)) introduced in Proposition 5.1 


may be used in this repair situation, but with an important conceptual distinction. In 


dyvnamic-service-selection, g,N(‘)) can no longer be interpreted as a proportion of service 
received by an item of type / in the interval (¢, 1+ dr), as was the case in processor 
sharing. Now, ¢,N(‘)) is only defined for s marking the epoch of a service completion, 
and has only one interpretation -- the probability that an item of type / is selected to 


receive the next available service. 


1. Renewal Theory Approach to the Repair Service Situation 

Consider a random variable which is the number of service completions of type 
¢ in the interval [0, 7], and let C, denote a cycle length between successive service com- 
pletions of type i. A renewal theory result states that if C, has expectation E[C,], and 
variance var[C,] , then the number of service completions in time ¢ has expectation 
tE[C]-!, and variance ¢ var[C,] E[C,]-> asymptotically as t— oo; see Feller [Ref. 40, p. 
sae) 

An alternative to the processor-sharing model represented by Equation (5.1) can 
now be written directly by replacing the v, g(N(t)) terms which were justified by the as- 
sumption that service completions resemble a Poisson process in short time periods. 
Using the mean and variance coefficients obtained from the renewal theory approach, 


Equation (5.1) becomes: 


Owes UG lah = ICT ais 


ee (5.29) 
+ 4; (K; = 4) > vanliGieee |] alr) , 


for;=1,..., 7, where {1V(2); 1 > 0} are independent standard Wiener processes. 

To obtain closed-form approximations for E[C,] and var[C] , consider the 
length of a cvcle when the system is in state n=([n,, 7,,...,7,] , where n,= N(r). The 
cycle time C; begins when a type / item completes service and ends when the next type / 


item completes service. The cycle time C, may be written as: 


S;+C)* with probability g(n), y#s ; (5.30) 


S; with probability g,(n) 
C; = 

where S, is the service time of item /. The justification for Equation (5.30) is that when 
an item of type / completes service, either another item of type / is chosen to Start ser- 
vice, an event of probability g{n), or an item of type j , jj #i, is chosen and after it 
completes service the cycle starts over in a state near enough to n so that C,* has the 


same distribution as C,, an event of probability g(n), j#i. This is justified under the 
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heavy traffic and large a conditions previously specified for the use of the diffusion ap- 


proximation. Taking expectations, and using E[S]] = _ gives 


EGl= ) bain) + EICI(— aim) 


j 
This is solved for E[C}, giving 


] ] 
E[C] = “ay 2 qn). (5.31) 


This approach leads to a simple alteration of the differential equations for the mean 


queue lengths, (2), derived under processor-sharing, that enables them to describe DSS. 


Proposition 5.2: If q(n) is of the form 


1 f(n;) 


a(n) == 


ys hid x) 


k 


_ _ = W, 
where f(7,) is an arbitrary function of , and w, and q(n) are defined by w,=—— , and 
t 


i (5.32) 
> Hafler) 
k 
then 
BIG) = 40) - (5.33) 


Proof: From Equation (5.31): 
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ise 
9 
i 
| 


Cn Smee) 
Letting w, = ca 


Ere lm =v, ae 
»% f(r) 
J 
Defining 
~ wi; film) 
q(n) = oC 
> ful) 
k 
then 


E[C] =v, q(n) . § 


In this form it is seen that by using modified weights, 1.e., dividing the original 
item weights by the item service rates, the differential equations for the means are of the 
same form as in the processor-sharing model. These modified weights reduce to the or- 
iginal weights in the special case when service rates are equal. Thus the modified weights 
can be interpreted as the correction to the means to modify the service discipline from 


processor-sharing to dvnamic-service-selection. 
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The form of q{n) in Proposition 5.2 is more general than the form given in 
Proposition 5.1 so this simple modification applies to specializations of Proposition 5.1. 
For example, if gn) is defined by the following: 


aa) = 
2 (ny 


Then 
s w; (n,P 
G0) i ee 
»%, (nj 
J 
SO 
where w=. For p=1, and all w,=1, this modification is equivalent to the 


processor-sharing approximation of FCFS reported by Gaver and Lehoczkvy [Ref. 41). 


This FCFS approximation is discussed in a following section. 


Starting again with (5.30), a similar derivation gives the second moment and 


ence variance of C: 


q(n) 
var[C,] = m5 » 3 
Fae 


Using (5.33), (5.32), and (5.34), the following term, which is the approximate component 








+ ECP - SEC) . (5.34) 


of the variance in d\(r) due to departures, is derived: 


G : z q(n) 
ay = v, q{n) ( 1 + 2 q{n) “), > — 1 t) (9.35) 
j 


In the special case of equal service rates, (5.35) reduces to v, g{n) = v, q{n) , Which is the 





Same as in the processor-sharing model. Thus the term within the large parentheses can 
be interpreted as the variance correction to modify the service discipline from 


processor-sharing to dynamic-service-selection. 


§9 


Using (5.33) and (5.35), the model given by (5.29) becomes 


dN{t)= 1,(K,— Nt) dt — v,9,(n) dt 


+ [atai- ston tin (1+ 2804 1), . i} awn °°) 
s| 


fori=1,..., 7. Applying the diffusion approximation to (5.36), the following differential 





equations are obtained for the scaled mean queue lengths and covariance matrix ele- 


ments: 

dmjt) = 2;(a;— m{1)) dt — n; g,(m(z)) dr; (5.37) 
fon =a ee 

Su = (BA1)) Se Siig T(t) o(2)) ; (S2e3)) 
a 
and 
do ;(t) 
—— SC(Higld ) ont) + (Halt) ond); (5.39) 
kai 
for i+ Jj; where 
YC; < = 
Ie Ce) q(m(z)) (1 — g(m(z))) , 


[ae By + cj mit 


¥ C; oe, mS 
H,(2) = uy, tomo. gAm(2)) g(m(z)) , 


fon +), 


Bilt) = A; (oj, -— mn) +V; , 


a a ml 
V;= Hw; qAm(2)) ( 1+ 2 q(m(z)) c rs ct -f ; 


i] 
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and where 


= [B, + c, m2)’ 


Ww 
2 [B, + cy m/s) 
/ 


q(in(z)) = 


The next sections introduce reasonable specific forms for the service selection 
probabilities, ¢(N(z)). 


2. Probabilistic-Longest-Line Service Discipline 
The general form of g(N(z)) given in Proposition 5.1 may be specialized to a 
family of functions that can be useful for analysis of a rule that gives service priority 
based on queue length. If 6, is set equal to 0, c, set to 1, and y set to p, then the general 
function becomes 


FEN) = Hy NCP 
This gives the service probability 


W; N; 
gAN(d)) = nad (5.40) 


»% Nf 1 
J 


This family of functions will be collectively referred to as a model of the 
Probabilistic-Longest-Line with parameter p (PLL;p) service discipline. 

Here w, is a weight for items of type?. This weight could be a function of the 
failure rate or average service time for an item of that type, or it could be a reasonable 
measure of the mission importance of an item of that type. Alternatively, w, can be re- 
garded as a decision variable at the disposal of an executive who wishes to optimize 
some feature of the combined backlog. 

For p=1 and w,=1 for i=1,...,/7, 9{(N(d) represents the traditional 
processor-sharing discipline. 

Higher values for p could be used to get an analytical solution which approxi- 
mates a rule which selects the item with the longest queue for service, which will be re- 


ferred to as the Longest-Line-First (LLF) discipline. 
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3. First-Come-First-Served Service Discipline 

Gaver and Lehoczky [Ref. 41] demonstrated that, in the special case corre- 
sponding to what is here called PLL;1, if w,= 1/u, then (5.40) will lead to the system 
reaching approximately the same steady-state as with the first-come-first-served (FCFS) 
service discipline. They stated, however, that the transient behavior had not been vali- 
dated. With the use of this diffusion model, the accuracy, during the transient response 
of the system, of approximating FCFS by PLL;1 with w,= 1/y, 1s now confirmed nu- 
merically. This allows a computationally feasible analytic study of FCFS which by 
Markov chain methods would require a significantly expanded state space. Selected 


numerical results will be given later. 


4. Probabilistic-Lowest-Availability Service Discipline 
The general form of ¢{(N(z)) given in Proposition 5.1 may also be specialized to 
a familv of functions that can be useful for analysis of a rule that gives service priority 
based on item availability. If bis set equal to K,, c; set to -1, and y set to —p, for positive 


p, then the general function becomes 
9, (K; — N(Oy? 
Dy (Ky — NO)? 


/ 


g(N(0) = (5.41) 


This famuly of functions will be collectively referred to as a model of the 
Probabilistic-Lowest-Availabilitv with parameter p (PLA;p) service discipline. 

Here w, 1s a weight as discussed in the PLL;p service discipline. The difference 
(K,— .V(1)) 1s the item availabilitv. For p=1, g(N(z)) represents probabilistic service 
proportional to the weighted inverse of item availability (i.e., a lower number of avail- 
able items implies higher priority for service). 

Higher values for p can be used to get an analytical solution which approxi- 
mates a rule which selects the item with the lowest availability for service, which will be 


referred to as the Lowest-Availability-First (LAF) discipline. 


5. Morrison’s Generating Function Approach 
Another approach to obtaining a steady-state solution for this problem has been 
proposed by Morrison; see Morrison, Gaver, and Pilnick [Ref. 42]. Working in the ori- 


ginal discrete state space of the continuous time Markov process, P(n;r) , where 


a2 


n= (n,,..., 7), 1s defined as the probability that there are x, items of type j, j= 1,..., J, 
in the system at time /, and that an item of type /is in service. Suitable boundary con- 
ditions are also defined. Transition probabilities are then used to write down the 


Kolmogorov Forward Equations for the system. Then, defining the limiting probabili- 
ties 


p,(n) = jim P{n;2) 


steady-state balance equations are derived. The strategy at this point is to work with a 


transform, or generating function, of the limiting probabilities defined as 


u{x) = Sy p,(n) x; is soil 


0<n<K 
and the partial derivatives 
Cu{Xx) SS n n 
6 re -D; Lhe Maye 
i Cx. vas nj p(n) xy x] 
J 0<n<K 


Anticipating these transformations, the balance equations are summed over the States 
and multiplied bv the appropriate products of the transform arguments, x, Then, the 
parameters and variables of the problem are scaled as in the diffusion approximation, 
ie., K,=aoa,,v,=ayp, and now x, = 1 — (é,/a) , introducing W(¢) = u(x). An asymptotic 
expansion of w(¢) is assumed. The lowest order terms then lead to a system of partial 
differential equations for which the form of the solution can be recognized, which ulti- 
mately leads to the steady-state solution for the mean numbers in the system. The next 
higher order terms of the expansion lead to the steady-state solution for the covariances 
of the numbers in the system in the special case where the arrival rates are equal and the 


service discipline is modeled by 


Linde 
ai(mm(.)) = : 
Yea md 


[Omi sles]. 
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The steady-state solution by this method, and by the diffusion approximation 
agree in the means, but not exactly in the covariances for different v, There is agreement 
when the service rates are equal. For all examples treated, the agreement has been use- 
fully good, even when service rates differ. Appendix F has the resulting steady-state 
expressions by both methods. In the special cases where Morrison’s solution is appli- 
cable, the numerical examples which follow compare the results. The principal advan- 
tage of the diffusion approximation over this approach 1s that this method does not 
easily give the transient response of the system. Also, the above method cannot provide 
information when services are not Markovian, whereas the diffusion approximation does 
an adequate job. (The extension of the diffusion approximation DSS model to service 
times with a general distribution is taken up in a later section.) At present, the preceding 
diffusion approximation provides the only analytical-numerical approach to the service 


problem described that can be used for time-dependent logistics applications. 


D. NUMERICAL EXAMPLES 

Several example problems were run to examine the results of using the diffusion 
approximation. The numerical solution results were compared to corresponding simu- 
lation results, and in very special cases, to direct analytic results. 

All numerical solutions of the differential equations were carried out on an IBM 
3033 computer at the Naval Postgraduate School using the IMSL Release 10 subroutine 
IVPAG with the Adams-Moulton method (see IMSL [Ref. 43]). Solutions for the mean 
and variance of queue lengths were computed for cases in which repair service is pro- 
vided probabilistically using functions of the form considered in Proposition 5.1. 

All simulations were also carried out on the IBM 3033 computer at the Naval 
Postgraduate School, using the LLRANDOMII random number generating package 
(see Lewis and Uribe [Ref. 44]). Time-dependent queue lengths were simulated. An 
event clock was advanced at either job arrivals or service completions, at which time the 
queue lengths were either incremented or decremented accordingly. The current queue 
lengths were recorded at fixed discrete time steps as the process evolved. For each case, 
500 independent replications were completed. Sample moments at each integer time unit 
were computed, for comparison with the results of the numerical solution of the differ- 
ential equations obtained from the diffusion approximation. In addition, sample data 
were taken from the simulation to assess the validity of the assumption of normality 


underlying the heavy traffic model. In different cases in the simulations, the item to re- 
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ceive service following a service completion was either selected probabilistically using 
probabilities corresponding to the diffusion approximation cases, or deterministically 
from a distinguished queue, such as the longest (i.e., using the longest-line-first (LLF) 
discipline). 

In addition to the time-dependent results from the diffusion approximation and the 
simulation, steady-state moments, using both the diffusion approximation and 
Morrison’s results, were computed in some cases to check the time-dependent results. 
The latter should agree with the former as time increases. A simple check was to con- 
sider the special case in which there was only one type of item so that the problem re- 
duced to the classical repairman problem for which analytical steady-state mean and 
variance could be directly computed. 

Another check was to use the diffusion approximation to directly compute steady- 
state mean queue lengths to check the results obtained from the numerical solution of 
the differential equations. The method used to compute the steady-state mean involved 
setting the rate of change in the deterministic differential equations (5.19) to zero, sum- 
ming over al] item tvpes, using Newton's method to find the fixed point for the denom- 
inator of the g{m(zs)) terms, then backsolving for each steady-state m(z); see Morrison, 
Gaver, and Pilnick [Ref. 42]. Details are found in Appendix F. Similarly, the diffusion 
approximation was used to directly compute the steady-state queue length variances in 
the special case of equal failure rates. 

It may be mentioned here, that on the mainframe computer, the diffusion approxi- 
mation approach took only a few seconds to return a numerical solution to the differ- 
ential equations in the longest cases. The program was written in FORTRAN and could 
be compiled and run on a personal computer. An implementation of the diffusion ap- 
proximation approach on a PC would provide a maintenance policy decision maker with 
a tool to reasonably compare alternative policies. In contrast to the rapid computation 
of the diffusion approximation solution, the simulation took approximately fifteen min- 


utes to run on the mainframe, and would run much longer on a PC. 


Example 5.1: As an example of an analysis of a repair policy that gives service pri- 
Oritv based on which queue is longest, i.e., PLL;p service, numerical examples with a 
common input and various solution methods are compared. The inputs for this example 
are shown in Figure 12. This example is a special case in which all service rates are 


equal so that the system behaves as if the service discipline were processor-sharing. 


Oo 
ty 





Figure 12. Example 5.1 Inputs 


Results for Example 5.1 are obtained and presented for each of the following cases. 

a. Case APLL;! (Diffusion Approximation, PLL;1 Service). This case is the nu- 

merical solution obtained from the diffusion approximation in which the service rule is 
modeled by the probabilistic form 


g{iN@) = — Nay (5.42) 


yoy Noy? 


J 


with the parameter p set equal to 1, which approximates FCFS. 

b. Case APLL:p (Diffusion Approximation, PLL;p Service). This case is the 1s 
the same as Case APLL;1, but with the parameter p set equal to a high value, in this 
example 2, 10, 20, and finally as high as 30, to get an analytical solution which approx- 
imates deterministic service of the longest queue. 

c. Case SPLL;! (Simulation, PLL;1 Service). This case is the simulation outcome 
in Which the service discipline is randomized selection of the next queue for service, upon 
each service completion, in accordance with probabilities using (5.42). 

d. Case SFCFS (Simulation, FCFS Service). This case is the simulation outcome 
in which the service discipline is first-come-first-serve. 

e. Case SLLF (Simulation, LLF Service). This case is the simulation outcome in 


which the service discipline is to serve the longest queue upon each service completion. 


For Example 5.1, a tvpical resulting queue length as a function of time is shown in 


Figure 13. Results are shown for the queue developed for one of the iteins, for the sol- 
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utions of Cases APLL;1 and SPLL;1, to compare diffusion approximation results with 
corresponding simulation results. 


Diffusion Approx. 
Mean 
One Std. Dev. 


Simulation 
Mean 
One Sta. Dev. 





Figure 13. Example 5.1 Queue Length vs. Time 


Numerical results for Example 5.1 are summarized in Figure 14. Results are given 
for each case at time increments of 100 time units. The values listed are the mean queue 
lengths with standard deviations in parentheses. Standard errors and confidence inter- 
vals for the point estimates for the means obtained from the simulation are omitted from 
the tabulated results to avoid more clutter in the table. Upper and lower .95 confidence 
limits for the means are the point estimate +.0877 times the corresponding estimate for 
the standard deviation (i.e., about + 10% of the standard deviation). Upper and lower 
.95 confidence limits for the standard deviations are .942 and 1.066 times the point esti- 
mate (1.e., about + 5%); see Lewis and Orav [Ref. 45]. 
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Case 


t=100 

SFCFS 
SPLL; 1 
APLL; 1 
APLL; 2 
APLL; 10 
APLL; 20 
APLL; 30 
SLLF 
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t=200 
SFCFS 
SF Diese 


APLL; 1 
APLL; 2 
APLL; 10 
APLL; 20 
APLL; 30 
SiGe 
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t=300 
SFCFS 
SPLL; 1 
APLL; 1 
APLL; 2 
APLL; 10 
APLL; 20 
APLL; 30 
SLLF 


He DOD OD LO WD 
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eS O WD WO bho © O 





Figure 14a. Example 5.1 Results Summary: means (standard deviations) 
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Case N y(t) N5(Ct) N23(C) Nz,(f) Ns(C) 


t=400 
SFCFS Bomgm540) 64.9 (564) 973-3 (5.9) 81.8 (5.5) 89.7 (6.1) 
SPLL;1 57.3 (5.1) 64.6 (5.4) 73.8 (5.6) 82.0 (5.8) 89.9 (5.8) 
Peiwieee 57a2 (5.2) 65.3 (5.5) 73:6.(5.7) 82.0 (5:9) 90.5 (6.2) 
Mme; 2 61.9 (4.5) 67.9 (4.8) 74.0°(5.1) 80.1 (5.4) 86.1 (5.6) 
aie; 10) 970.5 305) 72.8 (3.7) 74.8 (3.9) 76.6 (4.1) 78.3 (463) 
Pea 20 7205 (3.3) 73.8 (3.5) 74.9 (3.6) 75.9 (3.7) 76.7 (3.8) 
melee sO lw see (3.2) 74.2 (3.4) 74.9 (3.5) 75.6 (3.6) 76.2 (3.6) 
SLLF emo C340) 7454 (320) 74.8 (3.0) 75.2 (3.0) 75.7 (3.1) 
t=500 
SFCFS Be (521) 6505 (596): 73.7 Gbe0) 810666589) 9053 466-0) 
SPLL;1 56.8 (5.1) 65.5 (5.3) 73.5 (5.4) 82.0 (5.7) 90.3 (5.9) 
ei: 57.5 (5.2) 65.6 (5.5) 73.8 (5.7) 82.2 (5.9) 90.8 (6.0) 
APLL;2 62.2 (4.5) 68.2 (4.8) 74.3 (5.1) 80.4 (5.4) 86.5 (5.6) 
ETL; 10 70.8 (3.4) 73.1 (3.7) 75.2 (3.9) 77.0 (4.1) 78.7 (4.3) 
meme 20 72.8 (3.3) 74.1 (3.4) 75.2 (3.6) 76.2 (3.7) 77.1 (3.8) 
Peiies0r 73.5 (3.2) 74.5 (3.4) 75.3 (3.5) 75.9°(3.5) 76.5 (3.6) 
SLLE Femme) 9 74.5 (3.3) 749 (3. 3mm 5 OMS) © 75. 8 a63. 3) 
t=600 
SFCFS 57.4 (5.0) 65.6 (5.3) 73.5 (5.5) 82.3 (5.8) 90.4 (6.0) 
SPLL;1 57.5 (5.1) 65.7 (5.5) 73.7 (5.6) 82.2 (5.8) 91.0 (6.0) 
APLL;1 57.6 (5.2) 65.6 (5.4) 73.9 (5.7) 82.3 (5.9) 90.9 (6.0) 
APLL;2 62.3 (4.5) 68.3 (4.8) 74.4 (5.1) 80.5 (5.4) 86.6 (5.6) 
eboney O.9 (384) 73.2 (3.7) 975.3 (3-9) 77.1 (4.1) 78.8 (4.3) 
eM. 72-9 (3.3) 74.2 (3-4) 75.3 (3.6) 76.3 G3.7) 77.263.8) 
APLL;30 73.6 (3.2) 74.6 (3.3) 75.4 (3.5) 76.0 (3.6) 76.6 (3.6) 
SLLF ome (me 746 (3.0) 75.1703. Om 75.5 01) 75.9 (3.8 
t=700 
SFCFS 57.4 (4.8) 65.7 (5.5) 73.6 (5.9) 82.2 (6.0) 90.8 (5.8) 
peed 57.2 (5.3) 65.3 (5.6) 73.7 (5.9) 81.8 (5.5) 90.6 (6.3) 
Aumiedees7.6 (5.2) 65.7 (5.4) 73.99(5.7) 82.4 (5.9) 90.9 (6.0) 
APLL:2 62.3 (4.5) 68.4 (4.8) 74.4 (5.1) 80.5 (5.4) 86.6 (5.6) 
eeeome7 0.9 (3.4) 73.2 (3.7) 75.3 (3.9) 77.1 (4.1) 78.8 (4.3) 
pemeeome7e. 9 (3.3) 74.2 (3.4) 75.4 (3.6) 76.3 (3.7) 77.2 (3.9) 
pemmee0 975.7 (3.2) 74.6 (3.3) 75.4 (3.5) 76.0 (3.5) 76.6 (3.6) 
SLLF pemsGe2)  740eme. 2) 75.2°¢3.2) 975.7 (3.3) 76.1 (3.3) 


Figure 14b. Example 5.1 Results Summary: means (standard deviations) (cont.) 


Discussion of the Tabulated Results: At all t, the results show good agreement be- 
tween cases SPLL;1 and APLL;1, 1.e., the diffusion approximation yields solutions close 


to the results from the simulation with probabilistic service. There 1s also good agree- 
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ment between cases APLL;30 and SLLF; i.e., the diffusion approximation with a high 
power of p yields solutions close to the results from the simulation with service of the 
longest line first. The longest-line-first discipline tends to drive the items toward equal 
queue lengths. This makes intuitive sense since whenever the number of items awaiting 
repair for one particular item exceeds the number awaiting repair for the other items, it 
gets preferential service. At each time shown in the results, the effect of increasing the 
power p is seen to move the diffusion approximation results toward the LLF results. 


Sample data were taken from the simulation in Case SPLL;1 of Example 5.1 to as- 
sess the validitv of the assumption of normality underlying the heavy traffic model at 
times when the system was in transient and steady-state phases. 

For a transient phase time, ¢ = 50, an empirical histogram of the data for one of the 
item types is shown in Figure 15, with a Normal density overlaid on the histogram. 
Also shown is a Normal probability (quantile-quantile) plot. The chi-square goodness 
of fit test for this example vielded a test statistic of 5.336, with 5 degrees of freedom, and 
a significance level of 0.376, 1.e., no significant departure from normality. 

For a steady-state time, ¢ = 700, the histogram, normal density and probability plots 
are shown in Figure 16. At z= 700, the chi-square goodness of fit test for this example 
vielded a test statistic of 37.2, with 6 degrees of freedom, and a significance level of 
1.6 x 10-®, 1.e., statistically significant departure from normality. However, the proba- 
bility plot shows good agreement from the first through the 99th percentiles, and con- 
sequently, the diffusion approximation does yield good agreement with the simulation 
results. 
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Figure 15. Example 5.1 Queue Length Normality (transient) 
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NORMAL DENSITY FUNCTION, N=S00 
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Example 5.1 Queue Length Normality (steady-state) 


Figure 16. 
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Example 5.2: In this example, several cases are presented to demonstrate the results 
using the dynamic-service-selection model, using different inputs (especially different 
service rates). The inputs for this example are shown in Figure 17. All cases in this 
example use the same repair policy -- PLL;I -- service priority proportional to queue- 
length (w,=1, for alli, andp=1). 


Case l 
Case 2 
Case 3 


Case 4 


All Cases 





Figure 17. Example 5.2 Inputs 


Transient Results: For each case in Example 5.2, a typical resulting queue length as 
a function of time is shown in Figure 18. Results are shown for the queue developed 
for one of the items, comparing the diffusion approximation differential equation sol- 
ution with the corresponding simulation results. Queue length means and standard de- 


viations were computed at unit time steps. 
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Figure 18a. Example 5.2, Cases 1 and 2, Queue Length vs. Time 
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Figure 18b. Example 5.2, Cases 3 and 4, Queue Length vs. Time 
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Steady-state Results: For each case in Example 5.2, steady-state numerical results 
are summarized in Figure 19. Also shown are 95 percent confidence intervals for the 
estimates obtained from the simulation, which were based upon steady-state observa- 
tions from time 1001 through time 2000, using the method of batch means, with ten 
batches each of length 100; see Welch [Ref. 46]. 
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Figure 19a. Example 5.2 Case 1 Steady-state Summary 
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1 1 Zz 3 4 5 


Means: 


Diff. Approx. (ODE) 39.18 78.37 117.55 156.73 195.91 
Sim. 39.10 78.17 117.35 156.26 195.57 


sam. 9. 95CI lower 39.03 Poweem lig.i2 55795 195.30 
i.mesocl upper 39.18 ro. 26m iy. 57 156.57 195764 


Standard Deviations: 


Diff. Approx. (SDE) 2.65 4233 a. 90 7.24 8.56 
Morrison(gen.fcn.) 2.78 4.25 5:85 fuel 3 8.34 
Sc. 2.96 Ge 2al 5:90 219 S33 
Sim. .95CI lower 2.95 4.16 3. 81 i 13 8. 26 
Sim. .95CI upper Z80 Oly 6.00 7. 23 8.40 


Figure 19b. Example 5.2 Case 2 Steady-state Summary 
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Figure 19c. Example 5.2 Case 3 Steady-state Summary 
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Means: 
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Figure 19d. Example 5.2 Case 4 Steady-state Summary 


Normality Analysis: Sample data taken from the simulation in Case 1 of Example 
3.2 to assess the validity of the assumption of normality underlying the heavy traffic 
model during the transient phase (time 50) and in steady-state (time 700) are plotted in 
histograms in Figure 20and Figure 21, respectivelv. Normal densities are overlaid on 


the histograms, and Normal probability (quantile-quantile) plots are shown. 
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Example 5.2 Case 1 Queue Length Normality (transient) 
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Example 5.2 Case 1 Queue Length Normality (steady-state) 


Figure 21. 
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Example 5.3: In this example, several cases are presented to demonstrate the results 
using the probabilistic-lowest-availability service discipline with the dynamic-service- 
selection model. In addition to the lowest-availability cases, cases with probabilistic- 
longest-line service and first-come-first-served service disciplines are presented for 
contrast. The inputs for this example are shown in Figure 22. 
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Figure 22. Example 5.3 Inputs 


Results for Example 5.3 are obtained and presented for each of the following cases. 


1. Probabilistic-lowest-availability (PLA;1) Cases. 
la. Case APLA;1 (Diffusion Approximation, PLA;1 Service). This case is the 
numerical solution obtained from the diffusion approximation in which the service rule 


is modeled by the probabilistic form 


w(K; — Ny? 
g’NQ)) = = 
any 0) 


i 
j 


(5.43) 


with the parameter p set equal to I. 
lb. Case SPLA;1 (Simulation, PLA;1 Service). This case is the simulation 
outcome in which the service discipline is randomized selection of the next queue for 


service, upon each service completion, in accordance with probabilities using (5.43). 
2. Lowest-availability-first (LAF) Cases. 


2a. Case APLA;10 (Diffusion Approximation, PLA;10 Service). This case 1s 


the is the same as Case APLA:;], but with the parameter p set equal to a high value, in 


ile 


this example 10, to get an analytical solution which approximates service of the item 
with the lowest availability first (LAF). 

2b. Case SLAF (Simulation, LAF Service). This case is the simulation out- 
come in which the service discipline is to select the item with the lowest availability to 


receive the next service upon each service completion. 


3. First-come-first-served (FCFS) Cases. 
3a. Case APLL;] (Diffusion Approximation, PLL;1 Service). This case is the 
numerical solution obtained from the diffusion approximation in which the service dis- 
cipline is probabilistic-longest-line with the parameter p set equal to 1, which approxi- 
mates FCFS. 
3b. Case SFCFS (Simulation, FCFS Service). This case is the simulation 


outcome in which the service discipline is first-come-first-serve. 


Transient Results: For Example 5.3, the transient responses of the system for all 
cases are summarized in tabular form in Figure 23a. and b.. Since the service discipline 
is based on the availability of each item, the output in this example shows the number 
Operational instead of the numbers in the queue for repair as in the previous examples. 
Means and standard deviations of the availability of each item as a function of time are 
given at selected times. Standard errors and confidence intervals for the point estimates 
for the means and standard deviations obtained from the simulation are omitted from 
the tabulated results to avoid more clutter in the table. Upper and lower .95 confidence 
limits for the means are the point estimate +.0877 times the corresponding estimate for 
the standard deviation (1.e., about + 10% of the standard deviation). Upper and lower 
95 confidence limits for the standard deviations are .942 and 1.066 times the point esti- 
mate (1.e., about + 5%). Following the tabulated results the transient availability of one 
of the items is displaved graphically as a function of time in Figure 24a., b. andc.. The 
plots show the solutions for both the means and standard deviations for each corre- 
sponding pair of cases to compare diffusion approximation results with corresponding 
simulation results. Mean item availability and standard deviations were computed at 
unit time steps. 
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Figure 23b. Example 5.3: Number Operational (Transient) 


Discussion of the Tabulated Results: At all t, the results show that the diffusion ap. 


proximation yields solutions close to the results from the corresponding simulation ir 
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both mean and standard deviation. Looking across the rows for all cases at all times, 
item 5 has the lowest availability. It may be seen that since it gets the most preferential 
service under LAF, the availability of item 5 drops the least rapidly under LAF than 
under PLA;1 or FCFS. However, the preferential treatment of item 5 is at the expense 
of item ] which has the highest availability at all tmes. Consequently, item | availability 
is dropping the most rapidly under LAF than under PLA;] or FCFS. Looking at the 
spread in means across items, it is seen that LAF tends to drive the item availabilities 
toward some average value. The standard deviations across the items, at all times, in 
all cases are fairly consistent. At all times the standard deviations under LAF are the 
lowest of the three cases, and FCFS the highest. The lowest standard deviations occur- 
ring under LAF is anticipated since that service discipline selects the next item for service 
deterministically. At times greater than about 150, the diffusion approximation standard 
deviation under APLA;10 is systematically higher than the simulation under SLAF. It 
is conjectured that the explanation for this is that even with as high a power as 10, 
APLA;10 is still a probabilistic service selection which inherently has more variation 
than LAF. 
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Figure 24a. Example 5.3 PLA;1I: Item 1 Number Operational 
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Figure 24b. Example 5.3 LAF: Item 1 Number Operational 
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Figure 24c. Example 5.3 FCFS: Item 1 Number Operational 
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Steady-state Results: For Example 5.3, steady-state numerical results are summa- 
rized in Figure 25a., b. andc.. As observed in the transient results, it is seen that LAF 
tends to drive the extreme item availabilities toward some average value. Comparing the 
steady-state results in PLA;] and FCFS, it is seen that the means are close, but the 
standard deviations in FCFS are consistently higher. As in the transient results, the 
standard deviations under LAF are lower than either PLA;1 or FCFS. 
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Figure 25a. Example 5.3 PLA;1i: Number Operational (Steady-state) 


Means: 
Item APLA; 10 
1 Ow, 
Z aepmele 
S 9.80 
4 9,64 
5 Sa yt 


Standard Deviations: 
Item APLA; 10 
ilptterts' 
1. 84 
tee eal: 
SZ 
1. 89 





Figure 25b. Example 5.3 LAF: Number Operational (Steady-state) 
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Figure 25c. Example 5.3 FCFS: Number Operational (Steady-state) 


E. APPLICATION: BAYESIAN BOOTSTRAPPING 


Since the solution of the svstem of differential equations is computationally fast, the 
diffusion approximation may be applied to a setting in which the failure rates and service 
times are not known exactly, but must be inferred from data. 

The idea, which will be called Parametric Bayesian Bootstrapping, is summarized as 
follows; see Efron [Ref. 47]. and Dalal, Fowlkes, and Hoadley [Ref. 48]. A non- 
informative prior distribution is assumed for each failure rate and service rate.4 Suppose 
some data are gathered on actual times to failure and service times. Using the likelihood 
functions for the data, and the priors, posterior distributions for the failure rates and 
service rates are determined. This much is the Bayesian part of the procedure. Then the 
bootstrap is used. For each replication of the bootstrap, the posterior distributions are 
sampled (1.e., pseudo-random failure rates and service rates are generated from the 
posterior distributions) to obtain a set of inputs for the diffusion approximation. From 
the diffusion approximation, an estimate is computed for, say, the probability that the 
number of each item awaiting or undergoing repair at a particular time of interest ex- 


ceeds some specified value. This estimate is actually a conditional value given the ran- 


. + Any pnor distribution may be assumed. A reason for perhaps using a non-informative prior 
is that it favors no possible values for each rate over any other, thus relying the most on the data; 
see Berger [Ref. 49]. 


120 


domly selected failure rate and service rate inputs. Sampling from the posterior for rates, 
and subsequent computation from the diffusion approximation are replicated to produce 
many such conditional estimates, which are then averaged to remove the condition on 
the uncertain failure and service rates. Note that it is the speed and ease of computation 
that is possible with the diffusion approximation that makes the above process feasible, 
particularly on small computers. 

Bayes Posterior Distributions. The Bayes posterior distributions are developed in the 
standard manner; see Berger [Ref. 49]. Given data are 


by, bj, ..» Og, times between failures for itemé; (=1,...,/ , 
and 


Yo Vin,---+%ir ‘times to repair for item; /=1,...,/ 


Let the vectors of data be collectively denoted b, andr, Using the assumption that each 
item has Markovian failures at rate 4,, and independent exponentially distributed service 


times with mean v-!, the likelihood functions are 


Oy 


b(7;, 5) = lal ei" 


and 


Shy, 


L(v;. r;) = 


Vi é 
j=! 


R, - vr 


Li * Ui e 
€ ’ 


R, 
= V; 


for ‘=1,...,/. The product of each likelihood function and the respective non- 


informative prior, €(/,) = 47', or Wv,) = v7', is proportional to the Bayes posterior den- 


sities as follows: 
E(Aib) oc Whe Me 


and 


V7 


R; — Te Fee l 
WV) oc viene 5 
Recognizing the form of the gamma density, the constants of proportionality are chosen 


to get the posterior density functions 





; bis B,-1 .—2,6 
6A4; b) = TB) Ai € iat (5.44) 
and 
ris R,;-1 .- vr, 
Wi(r5; r;) - r(R)) vi" Chg ae (5.45) 


A Measure of Effectiveness. In general, the bootstrap can be used to obtain an es- 
timate of any computable function of the failure and service rates, which will be denoted 
6(4, x). To illustrate how the results obtained from the diffusion approximation might 
be used, the following measure of effectiveness will be considered. Suppose it 1s of in- 
terest if the operable number of item / at time t 1s below some critical value x, An ap- 


propriate measure of effectiveness then 1s 
6(4, x) = P{K,— N{z) <x} , 
or 
O(4, ¥) = P{N(t) 2 Ay— x} 
Using the normal approximation which is applicable when the system is in heavy traffic 


6(2, 2) = Pla mit) + ya X(t) = K,— x} 


‘a X(t) BN So = @ mj(t)} 


K; — x; — a m{t) 
a 


<Q 


ss 
la o;(t) 


\ 


( Acacan 
=] — o| —————_ ] 
./a03(z) 





Where © is the standard normal cumulative distribution function. In the foregoing it has 
been left implicit that m(zt) = m(t; 24, v) , and 6?(t) = 0%(t;24,v). The MOE, 6(4, v), can 
be viewed as the conditional probability that the availability of item jis less than ~, at 
time t. To remove the condition on / and vy, leaving only the condition on the data, the 
bootstrap 1s used. 


The Parametric Bayesian Bootstrapping Method. 
a. Sample from gamma density (5.44) for /,, i=1,..., 7, and from (5.45) for v,, 
a—sl-.>, 1. 
b. Compute mt), and o?(t) using the diffusion approximation. 
c. Calculate 6(4, v) using the standard normal! distribution. 


d. Repeat a. through c., say, 100 times and average the results. 


Example 5.4: This example illustrates the use of the diffusion approximation in a 
Bavesian Bootstrapping application. It uses the dynamic-service-selection model with 
the probabilistic-longest-line (PLL;1) service discipline in the diffusion approximation, 
aS an approximation to first-come-first-served (FCFS). The measure of effectiveness 
(MOE) to be examined in this example will be the probability that the number of each 
item remaining in operation drops to less than 50 at time 100; P( K, — \,(100) < 50). 


The results for the following three cases are presented: 


a. Case BB. Bavesian Bootstrapping with 100 replications. 

b. Case AR. Using Average Rates calculated from the data, for failures and ser- 
vice completions, with the diffusion approximation to obtain a point estimate of the 
MOE. No Bayesian Bootstrapping. 

c. Case TR. Using True Rates for failures and service completions with the dif- 
fusion approximation to obtain a point estimate of the MOE for comparison with the 
results obtained using limited data. These are the unknown true population parameters 


which were used to generate the failure time and service time data used in the example. 
The inputs for this example are shown in Figure 26a. through c.. The data were 


generated by drawing from exponential distributions with parameters equal to the true 


rates. 
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Figure 26b. 
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Example 5.4 Data: Times Between Failures 
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Figure 26c. Example 3.4 Data: Times to Repair 


The results obtained for each case are shown in Figure 27a. and b.. Next to the result- 
ing point estimates of the MOE under Case BB, in parentheses, are the standard errors 


obtained from the bootstrap. 


TR Case 


Expected Values 
46. 
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Figure 27a. Example 5.4: Number in Operation at t= 100 
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Figure 27b. Example 5.4 MOE: P( K; — N{100) < 50) 


Discussion of the Results: As should be anticipated, the results in each of the cases 
is different, the greatest differences occurring between the case that is based on the true 
population parameters, Case TR, and either of the cases that use the data, Cases AR 
and BB. But some significant differences also occurring between the two cases that use 
the data. The different results are most striking in Figure 27b. All the probabilities 
under case TR (true rates) are near 0 or I, in contrast to the other cases. The greatest 
difference in the table is for item 2 under Cases TR and AR. The Bayesian 
Bootstrapping standard errors indicate that there is a very significant spread in the MOE 
due to the uncertainty in the underlving failure and service rates. A conclusion that mav 
be reached from this small example is that with so littl data and a non-informative 
prior, there is too much uncertainty in the rates to conclude that there are significant 


differences between items using this MOE. 


F. GENERAL SERVICE DISTRIBUTIONS 


Due to the generality of the renewal theory approach used in deriving the dynamic- 
service-selection correction to processor-sharing, that model is easily extended by relax- 
ing the original assumption of exponential times to repair. 

Start again with Equation (5.30), however now rather than assuming that the service 
times, S, are exponentially distributed, simply retain the general form for the expected 
values, E[S,], and the second moments, E[S?], i= 1,... , J. 


Completing the derivation for the expected cycle length gives the following: 


qn 
E[S| ° 





E[c]"' = (5.46) 


where q(n) has the general form specified in Proposition 5.2: 


ae wi Sil) 
ia -S C—” 
> efile) 
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where f(,) is an arbitrary function of n, but now w, is defined by w, = E[S] w, . 
Then, after deriving an expression for the second moment of the cycle length, the 


following expression analogous to (5.35) is obtained: 


var[C] qi(n) Dak (var[S)] + ELS) 
aw a 
E[C]’ E[S]) pee) 2 Grae 


E[S;) )_ a(n) ELS) 
i 


L 


Note that the gn) within both summations use the original weights w, and not the 
modified weights w, = E[S] w,, as are used in the g(n). The simplification obtained in the 
case of exponential service times does not occur in the general service time distribution 
case. 

Using (5.46) and (5.47), the model given by (5.29) becomes 


dN {t) = 4;(K;- Nft)) at — ae at 
” YS g(ny(varlS) + ELS) Pe 
Be K, = NO) + sy oc) a > dW{r), 
E{S) > an) ES) 
ij 


J 
fom — |, 0,1. 

Previously, to apply the diffusion approximation, it was necessary to scale the ori- 
ginal exponential service rates, v,, and use u, =v,/a. Similar scaling is required for general 
service times. Let us = @ E[S] and of = @ var[S]. Note here that the symbol yu, 1s being 


used as a scaled mean Service time as opposed to the previous use of u as a scaled expo- 


nential service rate. As before, let K =aza,. and assume a service selection probability, 
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g(N(z)), of the form given in Proposition 5.1. Applying the diffusion approximation to 


(5.48), the following differential equations are obtained for the scaled mean queue 


lengths and covariance matrix elements: 
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Examples: Several examples are presented to demonstrate the results of using the 
diffusion approximation with general service times. The numerical solution results using 
the diffusion approximation are compared to corresponding simulation results. All of 
these examples use the PLL;] service discipline. Example 5.5 shows the results when the 
service times are deterministic, and Example 5.6 shows the results when the service times 
are taken from a gamma distribution. For comparison, Examples 5.5 and 5.6 use the 
Same mean Service times and other common inputs, except, of course, for service time 
Variance. Also, for comparison with the deterministic service times of Example 5.5, the 
gammia service times of Example 5.6 are taken to have a low coefficient of variation (1.-e., 
variance one-tenth the variance of an exponential with the same mean). For higher co- 
efficients of variation, Example 5.7 examines cases in which service times are taken from 
a log-normal distribution and a gamma distribution with variances four times the vari- 
ance of an exponential with the same mean. Example 5.7 also examines the effect of 
varying the weights, w,. in the service discipline function. Specifically, equal weights are 


compared with Weights set to the item traffic intensity p, = /, E[S]]. 


Example 5.5: This example demonstrates the results of using the diffusion approxi- 
mation when the service times are deterministic. The numerical solution results are 
compared to corresponding simulation results. This example uses the PLL;1 service 


discipline. The inputs for this example are shown in Figure 28. 


20 


Re, 50 100 150 200 250 
LF 01 02 03 02 01 
W 4 1.0 146 1.0 10 1.0 
N(0) 0 0 0 0 0 
E(S,) 2.0 1.0 | 3333 le eos umnooae 
vartS y) 0 0 0 0 0 


Figure 28. Example 5.5 Inputs 


Transient Results: For Example 5.5, the transient response of the system 1s sum- 
marized in tabular form in Figure 29, and then one of the queues is displayed graphically 
as a function of time. The tabulated results, showing the mean and standard deviation 
of the number in each queue as a function of time, are given at selected times. The plot 
in Figure 30 show the solutions for both the mean queue length for that item and 
standard deviation of queue length to compare diffusion approximation results with 
corresponding simulation results. Mean queue length and standard deviations were 
computed at unit time steps. Upper and lower .95 confidence limits for the means are 
the point estimate +.0877 times the corresponding estimate for the standard deviation 
(1.e., about + 10% of the standard deviation). Upper and lower .95 confidence limits for 
the standard deviations are .942 and 1.066 times the point estimate (i.e., about + 5%). 
At all 7, the results show that the diffusion approximation yields solutions close to the 


results from the simulation. 
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Figure 29. Example 5.5: Transient Nt) 
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Example 5.6: This example demonstrates the results of using the diffusion approxi- 
mation when the service times come from a gamma distribution with a high shape pa- 
rameter, and consequently low variance compared to an exponential with the same 
mean. Ihe numerical solution results are compared to corresponding simulation results. 
This example uses the PLL;1 service discipline. Except for service time variance, the 
inputs for this example are the same as for Example 5.5 and are shown in Figure 31. 
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Figure 31. Example 5.6 Inputs 


Transient Results: For Example 5.6, the transient response of the system is sum- 
marized in tabular form in Figure 32, and then one of the queues 1s displayed graphicallv 
as a function of time. The tabulated results, showing the mean and standard deviation 
of the number in each queue as a function of time, are given at selected times. The plot 
in Figure 33 show the solutions for both the mean queue length for that item and 
standard deviation of queue length to compare diffusion approximation results with 
corresponding simulation results. Mean queue length and standard deviations were 
computed at unit time steps. Upper and lower .95 confidence limits for the means are 
the point estimate +.0877 times the corresponding estimate for the standard deviation 
(i.e., about + 10% of the standard deviation). Upper and lower .95 confidence limits for 
the standard deviations are .942 and 1.066 times the point estimate (1.e., about + 5%). 
At all 2, the results show that the diffusion approximation yields solutions close to the 


results from the simulation. 
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Figure 32. Example 5.6: Transient V(r) 
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Figure 33. Example 5.6: N,(t) 
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Example 5.7: This example demonstrates the results of using the diffusion approxi- 
mation when the service times come from a distribution with a higher coefficient of 
variation. In this example, the variance of the service times are four times the variance 
of an exponential with the same mean, i.e., twice the standard deviation of the expo- 
nential. The simulations use service times taken from a log-normal distribution and a 
gamma distribution. In this example, the probabilistic-longest-line service discipline, 
PLL;1, is used. But in addition to unit weights, w,= 1 , the effect of varying the weights 
is examined. Specifically unit weights are compared with weighting the queue lengths 
by their respective traffic intensities p,= 7, E{S,]. In addition to comparing the diffusion 
approximation solution with simulations for service time coefficients of variation of 2, 
the diffusion approximation solutions for exponential service times (coefficient of vari- 
ation of 1) and deterministic service times (coefficient of variation of 0) are also pre- 
Senilec: 


The ten cases presented in this example are identified by the following codes: 


AtAas A; p30 
Ae ds) A;p3l 
Nae A; 93.2 
Gyre Grad 
1 gy Pe eye 72 


The first position indicates the solution method. Here the letter A represents the 
diffusion approximation solution, the letter G, the simulation with the gamma service 
time distribution, and the letter L, the simulation with log-normal service times. The 
second position indicates the type of weights. Here the number | represents equal unit 
weights, and the letter p represents tra:/ic intensity weights. The third position indicates 
the coefficient of variation. Here zero represents deterministic service times, | represents 
exponential service times, and 2 represents general service times. The inputs for this 


example are shown in Figure 34. 
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Figure 34. Example 5.7 Inputs 


Transient Results: For Example 5.7, the transient response of the svstem is sum- 
marized in tabular form in Figure 35a. and b., and then one of the queues is displaved 
graphically as a function of time. The tabulated results, showing the mean and standard 
deviation of the number in each queue as a function of time, are given at selected times. 
The plots in Figure 36 show the solutions for both the mean queue length for that item 
and standard deviation of queue length to compare diffusion approximation results with 
corresponding simulation results. Mean queue lengths and standard deviations were 
computed at unit time steps. Upper and lower .95 confidence limits for the means are 
the point estimate +.0877 times the corresponding estimate for the standard deviation 
(1.e., about + 10% of the standard deviation). Upper and lower .95 confidence limits for 
the standard deviations are .942 and 1.066 times the point estimate (1.e., about + 5%). 

Discussion of the Tabulated Results: At all 1, the results show that the diffusion ap- 
proximation vields solutions close to the results from the simulation. Within the 
grouping of results for by type of weights, it is seen that there is verv close agreement 
in the means for all solution methods and all coefficients of variation. For the standard 
deviations, there is a clear pattern of systematic differences due to the coefficient of 
Variation and the service time distribution used in the simulation. Part of the systematic 
differences are anticipated. It is quite reasonable to expect that as the coefhcient of 
Variation of the service times changes from 0 to | to 2, that the variation in the queue 
lengths also increases. That 1s reflected in the table. The other differences, between 


analytic and simulation solutions with the coefficient of variation of 2, show that there 


en 


are certainly higher moment effects that are not fully captured by the diffusion approx- 


imation. 
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Figure 35a. Example 5.7: Transient V(r) 
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Figure 35b. Example 5.7: Transient N{t) (cont.) 
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Figure 35c. 
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Example 5.7: Transient V(t) (cont.) 
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Example 5.7: N,(t); Unit Weights 
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Figure 36b. Example 5.7: N,(t); Traffic Intensity Weights 


142 


G. THE AIRCRAFT DETACHMENT REPAIRMAN MODEL 

This is a model of the aircraft detachment repairman problem with queue length 
influence. As before, the arrival rate of each type of failed item as seen at the mainte- 
nance shop will be the individual item failure rate, /,, multiplied by the number of items 
Operating at that time. However, in this model, the number of items operating is limited 
by the number of operational aircraft available. 

Let A, denote the number of aircraft assigned to the detachment. And let 4,(z) de- 


note the number of aircraft that are operationally available at time 7, defined by 
A(t) = min {A,, K, — N,(0), K, - N,(0),...,K,;- No}. (5:52) 


Hence, the time-dependent arrival rate of each type of failed item as seen by the 
repairman is /,; A(t), fori=1,..., 7, and the probability that a failed item of type / arrives 
at the repair shop in the interval (1, 1+ dz) is 4, A,(t) dt + o(dz). 

This modified arrival process, which will be carried through the derivation of the 
diffusion approximation, is the only new aspect of this model. Anv of the previously 
considered service processes and disciplines could be used here. Arbitrarily, the service 
times will be assumed to be exponential with mean 1/v, and the dynamic-service-selection 
correction to processor-sharing will be used. Then, modifving only the failure process 
terms in Equation (5.36), the following system of stochastic differential equations are 


obtained: 


dN{t)= 7, A(t) dt — vi, q(N(d) dt 
=TN 
=f f A(t) +; unco( + 2 g{N(z)) J) _ 1) dV (1). (S708) 
/ 


fori=1,...,/; where {IV(r); 2 > 0} are independent standard Wiener processes. 

To deal with the minimization operator within the differential equations, two cases 
must now be considered. Case I will be the case when the available number of opera- 
tional aircraft is not limited by part availability (i.e., operational aircraft equal to aircraft 
assigned), and Case II will be the case when the available number of operational aircraft 
is limited bv the availability of one of the parts. 


Case I. If at some time /, 4,(1) = A,, then, at 7, (5.53) may be expressed as 
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dN(t)= 4, A,dt — v; q(N(2)) dt 


ne 
+ fader naioun( t+ 2a: J) a - 1) awiy, &°9 


/ 





Now let a= A,+ ¥K,, the total population of components and aircraft, and again 


consider the approximation 
N(t)=am(t)+JaX(t) . 


As before, let v,=y,a, and use the general service discipline form and expansion of 
Proposition 5.1. Now expressing A, as a fraction of a, let A,=o,a. After dividing 


through by a, (5.54) becomes 





dm(t) + —== dX(1) = 4,0, dt 


a 


~ i - 
— H; jamc( is a (x ) See _ C; — sebell Fz +6 mA EK) 


. ; ; q(m(:)) ‘ 
+aL para - i) ce 


i 








+o(l/ja) , 


where 


W; 
_ se B+ Gm 
g(m(1)) = 
>a [B, +o mol’ 


i 


Isolating terms of like order, the following systems of differential equations are obtained: 
Equations of Order 1. The equations of order | form the following system of ordi- 
nary differential equations: 


din(t) = 1,0, dt — w,9(m(.) dt, (5.55) 


fori =e 


Equations of Order 1\|,/a. The equations of order 1/./a form the following system 
of stochastic differential equations: 


7C 


dX(t)= — wu; ¢{m(v) tc Fel = 2X00 weet) q(m(z)) ; dt 


a no) (5.56) 
ai p o> Uy; uo a 2 q(m(t)) ») oo = i) daW({t) , 
J 


focr—l,..., 1. 


Case II. If at some time #, A,(t) = K, — V(t), where the subscript s denotes the part 
with the smallest availability, then, at 2, (5.53) may be expressed as 


dN(t) = 3, K,— Na) dt — v,9(N(0) dt 


=o awe) = y\ 
+f Ke — NO) +; jesco( + 2G(N() J) OO - i) aire? 
uf 


Using the same approximation, service discipline, and scaling of parameters as in Case 
I, and A, =¢, a. and then after dividing through by a, (5.57) becomes 





dm(t) + —& ax(y=i,(2,-mio- — exo ) 
a 4a 


\ 


= jmoy( 1+ — (x ere te — Frama um mt) 


4 = U ( a, — m,(t) — = xX) 
6 Z q(m(t)) ne = 
ap is ju pe jumoy}ns) i = a i) aie esol Ja yim, 
i 


where g({m(t)) is as given in Case J. Isolating terms of like order, the following systems 





of differential equations are obtained: 
Equations of Order 1. The equations of order 1 form the following system of ordi- 


nary differential equations: 


din{t) = 4; (a3 — m(a)) dt = 1; G(m(0)) de, (5.58) 
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ior? — eee 
Equations of Order 1]fa. The equations of order 1/,/a form the following system 


of stochastic differential equations: 


dX(t) = — 2, X,(1) dt — wu, g(m(2) Cee 2% Ope im) dt 


| - i g,(m(:)) Cog 
is f (a1, — m(0)) + a, Gmn(2)) (1+ 2340 ' 4 1) W(t), 
iy 


forma sles. 

The implication of the different cases to deal with the minimization operator is that 
as the controlling element of aircraft availability changes over time, the differential 
equations Which approximately describe the behavior of the system change. Since the 
differential equations require numerical solution in any case, the solver just has to be 
able to distinguish which case applies at each time step in the solution. The case may 


be determined up to order a by the minimization 
min {a,, (a,—7,()), ... , (a,—mfo)} . 


This is justified under the conditions previously specified for the use of the diffusion 
approximation, 1.e., large populations from which the failed parts arrive, a— co. Define 


the deterministic function «,(1) by 
a(f)= min fo,, (a, —7,()), ... , (a, —m,() } 
Then the applicable case is determined as following: 
{a(g=a,} = Casel 
{ a(t) =(a,—m()} = Case ll 


Using the function «,(z) to imply the applicable case, Equations (5.55) and (5.58) reduce 


to the common form 


dint) = 4; 0,(1) dt — yw; q,{m(1)) at (3.60) 
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for:=1,..., 7. Thus (5.60) is the system of ordinary differential equations for the time- 
dependent scaled mean queue lengths, for both Cases I and II. Similarly, for the 


stochastic differential equations, (5.56) and (5.59) reduce to the common form 
dX(1) = = 2, X,(0) 5(0,(2), a, — mg(2)) at 


al os 1 3 
Ls; g,(m(z)) (x00 B, +, mt) 240 B; -- C mt) q;(m(z)) dt i " 


a5 p a(t) + ut + 2 g(m(t)) ») _ = i) dW {t) , 
j 


fori=1,..., 7; where 6(a,(t), a, — m,(r)) is used as the Kronecker delta.5 





As before, (5.61) can be written in matrix form as 
daX(t) = H(t) X(t) dt + Bit) dW(2)_ ; (5.62) 
where H(z) is the / x J matrix 
H(:) = H'() — H*(0) 6(a,(), 0, -—m, (0); 
the elements of H'(z) are 


Hi) = — 6; Fe Heal) (1 — Gm()) 


and 
HY 1 Gem(o) G{m(0) 
2 pA 
: Be+ogmi(y ~ J 
for 1 #/; B(r) is an / x J diagonal matrix with elements 


: : i 
Bi(0) = [essa eaten (142 G00) - i} : 
/ 


5 The Kronecker delta is defined by the relationship 


a 1 if i=j, 
d(i, /) -45 if = 


147 


_ a [B; + ¢; may’ 
Gmn(:)) =< 
= [Bi +c m(t))’ 


) 
J 


and H?(t) has the column vector (A,, /,, ..., 4,)'1n the s* column and zeros elsewhere; 
s= argmin{ (a,—m,()), .. , (a;— md) } 


As before, since (5.62) is of Ornstein-Uhlenbeck form, the variance-covariance ma- 
trix has elements which satisfy (5.27) and (5.28). 


Example 5.8: As an example of an analvsis using the aircraft detachment model with 
a repair policy that gives service priority based on which item has the lowest availability, 
1.e., PLA:p service, numerical examples with a common input and various solution 
methods are compared. Note that for the diffusion approximation, the determination 
of the controlling minimum availability is carried out within the numerical differential 
equation solver at every time step, so that no other distinction need be made between 
the cases considered in deriving the differential equations. The simulation uses the ac- 
tual nunimum as it moves along the sample path 1n each replication. The inputs for this 


eNaimple due shown imemicunemen= 


1 2 3 4 > 


100 110 120 130 140 
OOS 02020 0025 0.030 02-035 
IESG aed Ly 2 Res 1.4 


10 10 1.20 0 1.0 
0 0 0 





Figure 37. Example 5.8 Inputs 


Results for Example 5.8 are obtained and presented for each of the following cases. 
a. Case APLA;1 (Diffusion Approximation, PLA;1 Service). This case is the nu- 
merical solution obtained from the diffusion approximation in which the service rule is 


modeled by the probabilistic form 
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w(K, — V(t)? 
> (Ky — NOY? 


J 


qAN()) = (5.63) 


with the parameter p set equal to l. 

b. Case APLA;p (Diffusion Approximation, PLA;p Service). This case is the same 
as Case APLA;I, but with the parameter p set equal to a high value, in this example 2, 
4, 8, and finally 10, to get an analytical solution which approximates deterministic ser- 
vice of the item with the lowest availability. 

c. Case SPLA;] (Simulation, PLA;1 Service). This case is the simulation outcome 
in which the service discipline is randomized selection of the next queue for service, upon 
each service completion, in accordance with probabilities using (5.63). 

d. Case SLAF (Simulation, LAF Service). This case is the simulation outcome in 
which the service discipline is to select the item with the lowest availability to receive the 
next service upon each service completion. 


Transient Results: For Example 5.8, the transient response of the system is summa- 
rized in tabular form in Figure 38, and then displaved graphically as a function of time. 
The tabulated results, showing the mean and standard deviation of the availability of 
each item as a function of time, are given at selected times for all the cases. The plots 
in Figure 39a. through e. show the solutions for Cases APLA;1 and SPLA;]. to compare 
diffusion approximation results with corresponding simulation results. The plots in 
Figure 40a. through e. show the solutions for Cases APLA;:10 and SLAF, to compare 
diffusion approximation results with corresponding simulation of the LAF service disci- 
pline. Mean item availabilities and standard deviations were computed at unit time 
steps. Standard errors and confidence intervals for the point estimates for the means 
obtained from the simulation are omitted from the tabulated results to avoid more clut- 
ter in the table. Upper and lower .95 confidence limits for the means are the point esti- 
mate +.0877 times the corresponding estimate for the standard deviation (1.e., about + 
10% of the standard deviation). Upper and lower .95 confidence limits for the standard 
deviations are .942 and 1.066 times the point estimate (1.e., about + 5%). 

Discussion of the Tabulated Results: At all t, the results show fairly good agreement 
between cases SPLA;] and APLA;], i.e., the diffusion approximation vields solutions 
close to the results from the simulation with probabilistic service. There is also fairlv 


good agreement between cases APLA;10 and SLLF; 1e., the diffusion approximation 
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with a high power of p yields solutions close to the results from the simulation with 
service of lowest-availability-first. The agreement between means is better than the 
agreement between the standard deviations. This is seen better in the graphical com- 
parisons. The lowest-availability-first discipline tends to drive the items toward equa 
availability in steady-state. This makes intuitive sense since whenever the availability for 
One particular item is less than the availability for the other items, it gets preferentia! 
service. At each time shown in the results, the effect of increasing the power p 1s seer 


to move the diffusion approximation results toward the LAF results. 


Means: Standard Deviations: 
Item: 1 2 3 4 5 il 2 3 4 5 

t = 50 
SPLA; 1 74.9 71.95 768756 “66.3 5964.0 6.6-/./7 \ 6248.6 
APLA; 1 74.9 72.1) 69.2) 166. 5aeece 6.6 7.4 8.1 96.6) Jae 
APLA; 2 75.4 7252 169.2 6672 ao 6.3 7207 J/.77° 625m 
APLA; 4 76.0 72.4 695057 65-S roc 5.9 6.5 - 720 “F725 (7a 
APLA; 8 76.7 72.4) 68.65 65. 42967 5.4 5.8 6.1967 4eGre 
APLA; 10 7/7. 72.0 682.0 WC G59 5.4) Oe OmoeG 6. Oneorre 
SLAF 75.7 -70<86 967.7% 165. 9 oan 4.7 5.2 4. 99458 S50 

t = 100 
SPLA; 1 58.26 GO es) 23 90e 0 as Olea 2! 8.4 9.4 10.3 9.0 6Gae@ 
APLA; 1 57.6 Gia soe on eel ee 7.9 "6./ 9.1.9.2. 7aa0 
APLA; 2 §5.2 44590 35.5 2377} eS 7.2. To) wmieo 7.0 5a 
APLA; 4 Sl. 9 (“Gil e2g oe 2) eee a 627 6.7 35.9 Gage Se 
APLA; 8 49:3 3/7245 30235. .27 58sec ome 6. J miOnilee 604. 1 oases 
APLA; 10 48-68 -35.9° "2954" 29 77 meee oes 6.8 §6.0 4.3 420 Vom 
© LAF 46.4 34.3 29.2. 267002 6:9 5.3 3:6 3335 

t = 150 
SPLA; 1 53.3 40 36m- S05 2c 8.9 974 9.1 so ae 
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Figure 38a. Example 5.8 Item Availability; Transient 
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Means: Standard Deviations: 
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Figure 38b. Example 5.8 Item Availability; Transient (cont.) 
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Discussion of the Graphical Comparisons: As seen in all the plots the agreement be- 
tween means is better than the agreement between the standard deviations. A clear 
feature in the plots of standard deviations in Figure 39a. through e., which compare 
Cases APLA;1 and SPLA;1, is the point at which the diffusion approximation and the 
simulation results separate. That point occurs at the same time, t= 60, for all items. 
That time corresponds to the point at which the availability of item 5 dropped below 
A,= 50, and the system of differential equations governing the system changed. AIl- 
though the absolute and relative errors between the diffusion approximation and simu- 
lation are much greater than in the previous model, especially in the standard deviations, 
the diffusion approximation curves do roughly follow the shape of the simulation re- 
sponse providing a usable approximation, even in the worst cases seen in Figure 39e. 
and Figure 40a. The agreement in the means 1s much better than the standard devi- 
ations. Some separation in means 1s seen in Figure 39a. through e., although this, too, 


shows a usable approximation. 
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Figure 39d. Example 5.8 Item 4 Availability, PLA;1 (transient) 
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Figure 40d. Example 5.8 Item 4 Availability, PLA;10 (transient) 
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Figure 40e. Example 5.8 Item 5 Availability, PLA;10 (transient) 





Steady-state Results: For Example 5.8, steady-state numerical results are summa- 
rized in Figure 4la. and b.. As discussed previously, the lowest-availability-first disci- 
pline tends to drive the items toward equal availability in steady-state. An interesting 
phenomenon which distinguishes the aircraft detachment model from the previous 
repairman model is evident in these results. In this model, the common value ap- 
proached under LAF is the same minimum availability as in PLA;1, rather than some 
average value as happened in the previous repairman model. 
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Figure 41a. Example 5.8 Steady-state Summary: PLA;I 
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Since the solution of the system of differential equations is computationally fast, and 
could be conveniently done on a small computer, and provides usable approximations 
of the transient behavior of the system, the diffusion approximation mav be used to ex- 
amine various service disciplines, and try various heuristic weights, w, to find the best 
policy with respect to a measure of effectiveness that uses the mean and variance of the 
number of items awaiting repair at any time, or equivalently, the aircraft availability at 
any time. 


Areas for further study in combat logistics support are discussed in the conclusions. 


VI. CONCLUSIONS AND FURTHER STUDY 
A. OPERATIONAL COMBAT LOGISTICS 


In the part of this thesis concerning operational combat logistics, a problem of op- 
erational interest in the Navy was defined and studied. The problem was to schedule the 
replenishment of weapons within a Navy Battle Group following a combat engagement, 
when the uncertain arrival of another attack may interrupt the replenishment process 
before all requirements are satisfied. 

The concept of combat logistics objectives as a fusion of pure combat and pure lo- 
gistics Objectives was introduced. The idea of dealing with an operational combat lo- 
gistics problem also came into consideration when choosing units of measurement. 

Simple stochastic optinuzation models were developed for the combat VERTREP 


problem and the combat CONREP problem. Methodologies were developed for calcu- 


lating the time it takes to conduct ammunition replenishments, and for quantifving the 


combat value of weapons in a Battle Group in a way that 1s useful for scheduling re- 
plenishment. 

In one simple model, optimal Vertical Replenishment scheduling was achieved with 
a dynamic allocation index, called Logistics Weighted Combat Value (LWCV). The 
LWCV method was then used in an efficient scheduling heuristic for a realistic model 
and produced results which compared very favorably with a locally optimum schedule 
obtained with a lengthy local neighborhood search. 

In a separate simple model, optimal Connected Replenishment scheduling was 
achieved with dynamic programming (DP). The DP approach was then adapted to more 


realistic situations. 


1. Further Research 


a. Heuristic Improvement of LWCV VERTREP Schedule 
It was nected that the use of exhaustive all-pairs and all-triples interchange 
improvement searches were certainly not t he only alternatives to staying with the initial 
schedule obtained with the LWCV heuristic. Although many general improvement 


techniques from the extensive combinatorial optimization literature could be tried, con- 


165 


-» Ww 


te 


sideration of the special characteristics of the VERTREP problem suggests investigating 
heuristic improvement methods tailored to the problem. 

It appears that the aspect of the general Battle Group VERTREP problem 
that has the greatest impact with respect to the optimality of the LWCV procedure is 
the occurrence of strikedown queues. The Battle Group VERTREP example of Chapter 
III demonstrates that a very significant qualitative difference between the initial and 
k-opt schedules can be attributed to when lifts of WepA are dispatched to Ship]. In that 
example, that weapon had both the highest combat potential and longest strikedown 
time in the Battle Group. Under the LWCV procedure, the long strikedown times led 
to the formation of strikedown queues which ultimately delaved the accrual of combat 
value of lifts backlogged on the deck of the receiver. Since the LWCV heuristic uses a 
forward induction policy, it can not look ahead to avoid that complication. The k-opt 
schedules, on the other hand, through a succession of interchanges, spread out the de- 
livery of that weapon, trading off some early helicopter delivery delay to obtain a se- 
quence which is more efficient by avoiding the wasred time that weapons would have 
spent in strikedown queues. 

A possible improvement heuristic that should be investigated is based on 
the foregoing observation that lifts with high combat value and long strikedown times 
need special consideration in scheduling. One heuristic would be to search for im- 
provements due to insertion of such a hift earher in the sequence than the LWCV 
heuristic provides. Many variants of this idea are easily conceived. 

An important consideration in any improvement strategy for the Combat 
VERTREP problem should be how long it takes to find notable improvements. It 1s 
conceivable that a user might specify an upper time limit for which he is willing to wait 
for improvements to an initial schedule. For example, if a good initial schedule is ob- 
tained in three seconds, the user may be willing to allow up to ten times that, or thirty 
seconds, for heuristic improvement. In such a situation, it would be particularly desira- 


ble to try to find a few high return improvements early. 


5. Dynamic Revision of CONREP with Strikedown Queues 
In Chapter IV, the idea of dynamic revision of a CONREP schedule was 
developed through the case of interrupting a receiver in progress and rescheduling under 
the assumption that strikedown queues did not occur for the receiver being interrupted. 


An important extension of this model is to consider the situation when strikedown 
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queues do occur. One possible approach to this problem that is left for further investi- 
gation 1s Outlined here. 

(1) The reason for the simplifving assumption that strikedown queues 
could not occur was so that any positive delav between when a receiver in progress was 
interrupted and when he was scheduled to start again would not affect strikedown com- 
pletion times. In contrast to this, if strikedown queues did develop, the receiver proc- 
essing times would include waiting time in the strikedown queue. Then a positive 
interruption delay would allow the strikedown queue to shorten (or empty), and hence 
reduce the receiver processing times following a delay. Furthermore, the amount by 
which the subsequent strikedown times are shortened would depend on the length of the 
delay, which would not be known until after rescheduling is finished. 

(2) An insight, which suggests a way to proceed, is to observe that al- 
though the length of the delay is variable, and consequently the amount by which the 
subsequent strikedown times are shortened is variable, at the point when an interruption 
occurs, the event time when a strikedown queue will emptv is fixed. To be specific, say 
there 1s only one weapon system with a strikedown queue, and let 6* denote the length 
of tume from when an interruption occurs until that strikedown queue empties. Also, let 
6 denote the delay from when an interruption occurs until the rescheduled receiver is 
delivered another lift of that weapon. 

(3) The presence of a strikedown queue may be thought of as an addi- 
tional constraint on the interruption with rescheduling problem, and the method intro- 
duced for the special case of no strikedown queues can be thought of as a relaxation of 
this additional constraint. A first step for the problem with strikedown queues 1s to solve 
the relaxation using Proposition 5.5 under the following conditions: 

(a) Pseudo-receiver ja, strikedown completion times for subse- 
quent lifts are not modified (i.e., include waiting time due to existing strikedown queue), 
since the scheduling of ja, represents the receiver in progress continuing without inter- 
ruption. This is the actual condition without any relaxation. 

(b) Pseudo-receiver ja, strikedown completion times assume no 
queue exists as of when ja, starts service. This is a relaxation, because this is the con- 
dition for 6 => 6*, but is optimistic for 6 < 0*. 

(4) The solution of the relaxation will fall into one of the three follow- 


ing cases: 
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(a) The receiver in progress is scheduled to continue without delay 
(i.e., ja, is scheduled to commence immediately). In this case, the occurrence of a 
strikedown queue has been accounted for, since the strikedown times were not modified. 

(b) The receiver in progress is actually interrupted and resched- 
uled (i.e., ja, is scheduled) following some delay such that 6 > 0*. In this case, the pre- 
vious occurrence of a strikedown queue has been accounted for, since the delay has 
allowed the queue to empty. 

(c) Pseudo-receiver ja, is scheduled, however the delay is such that 
6 < 6*. In this case, the previous occurrence of a strikedown queue has not been prop- 
erlv accounted for, since the strikedown completion times were overly optimistic. 

(5) For cases (a) and (b) above, the relaxation provided a schedule 
which is feasible for the original problem and is thus optimal. However, for case (c), 
more work is required. 

(6) A possible approach is to consider modifications to the backward 
induction of Proposition 4.5. The first modification must be that for states which in- 
clude pseudo-receiver ja,, the expressions for expected combat value contributions 
should be modified to reflect the fact that value for subsequent lifts can not accrue until 
after the fixed time when the previous strikedown queue empties. The second modifi- 
cation concerns how additional receivers are added to a state which includes ja, -- the 
kev point being how additional receivers and lifts are packed in before ja,. The packings 
fall into two categories. The first, which is related to case (b) above, concerns those 
combinations of receivers and lifts such that 6 > 6*, in which case ja, strikedown com- 
pletion times are referenced to 6 . The second category concerns those combinations 
of receivers and lifts such that 6 < 6*, in which case ja, strikedown completion times are 
Teferenceatoucue 


Working out the details of such an approach 1s an area for further study. 


c. Combined CONREP and VERTREP Scheduling 
The issue of finding a combined schedule for simultaneous CONREP and 
VERTREP requires further study. The separate models for scheduling VERTREP and 
CONREP may be combined heuristically as an initial approach. However, other than 
some intuitive appeal as a means of getting a schedule, no firm justification 1s offered. 
Additional investigation is needed. 
One possibility for heuristically combining the separate VERTREP and 


CONREP scheduling procedures is to consider a stepwise application of the two meth- 
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ods. An example of a stepwise method is outlined in the following, for which it is as- 
sumed that maneuvering orders have been issued to direct the receivers to close the 
delivery ship at best speed to a position where VERTREP flight time is minimized, and 
where the receiver is ready for CONREP if so ordered. 

(1) As the receivers are closing the delivery ship, an initial VERTREP 
schedule is generated and implemented through the time that the first receiver(s) are in 
a position where they could commence CONREP. 

(2) As of that time, the ammunition requests from each receiver are 
decremented by projected VERTREP deliveries, corresponding ammunition strikedown 
times are updated, and an initial CONREP schedule is generated for those receivers in 
position. 

(3) With the scheduled CONREP deliveries being accounted for, the 
VERTREP scheduling is continued, until another receiver is available to commence 
CONREP. 

(4) As of that time, dvnamic CONREP schedule revision is computed. 

(5) Step (3) and (4) are repeated until the entire combined schedule is 


generated. 


d. Conibat Value Functions 
Although the use of a utility scale for quantifving combat value is justified 
by the complexity of the combat scenarios facing a Battle Group, the Priority List 
Method presented in Appendix B is merely one possible approach. Further research 1s 
needed concerning the quantification of combat value functions for use in operational 


combat logistics models. 


e. Implementation in a Decision Support System 

The actual implementation of the models for scheduling ammunition re- 
plenishment during combat, including an appropriate user interface, 1s an area for fur- 
ther work. It is envisioned that such an implementation would be in the form of 
scheduling modules embedded in a larger Decision Support System available to the 
Battle Group Commander. 

The development of a Decision Support Svstem to support operational 
combat logistics at the Battle Group and Battle Force levels is the subject of ongoing 


work at the Naval Postgraduate School by Schradv and Wadsworth. 


169 


NY 


f. Optimal Maneuvering 

The issue of optimal maneuvering tactics for replenishment requires further 
study. At best, the methodology in this work allows maneuvering variables to be treated 
parametrically, so that various options could be considered using a whar if approach. 
Itis clear that CONREP and VERTREP schedules depend on the maneuvering tactics; 
and it is also clear that a good maneuvering plan depends on the combat value achiev- 
able in the replenishment. However, determination of the best maneuvering plan in the 
combat replenishment situation is really a multiple objective optimization problem. Be- 
sides the objective of maximizing the combat value of ammunition transferred before 
raid arrival, a verv important objective mav be tactically motivated. For example: min- 
imizing the exposure of the delivery ship and other high value units to submarine 
torpedo attack; or, if the Battle Group is withdrawing from the area due to damage from 
the last raid, maximizing the Battle Group movement in the direction of withdrawal. In 
addition, the maneuvering problem has constraints which include wind, sea state, and 
remaining in navigable waters. The problem of how to maneuver replenishment and 
combatant ships is the subject of ongoing work at the Naval Postgraduate School bv 


Hardgrave and Lawphongpanich. 


g. Ordnance on Deck 

Although the models considered in this work do not preclude decreasing combat value 
functions (1.e., negative marginal utilitv), they do not capture the possible loss in combat 
effectiveness due to logistics if a raid arrives while a strikedown is in progress, catching 
the receiver with weapons on deck. Besides not being ready for combat, ordnance on 
deck 1s vulnerable during an attack and may constitute a secondarv explosion hazard. 
Put another way, the models allow combat value to decrease deterministically due to 
assumptions of a pure combat model, but do not allow combat value to decrease 
stochastically due to logistics. 

For future study, a possible way to capture this real world consideration, 1s 
to incorporate a combat value penalty function which probabilistically decreases combat 


value if a raid arrives and finds weapons on deck. For example, using the notation of 


Chapter IV, expressions for expected total combat value, now include terms such as: 


+y,P[T>c] . 
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which represent the expected accrual of marginal combat value y, if a raid arrival, T, is 


later than the time of strikedown completion, c, Additional penalty terms which might 
also be included could take the form: 


— 23 Pix, < T< c)| ae 


for penalties z,>0. Such terms could represent an explicit penalty if the raid arrival 
came after the time of delivery, x, but before the time of strikedown completion. The 


idea of penalizing strikedown queues requires further investigation. 


B. COMBAT SUPPORT LOGISTICS 

In the part of this thesis concerning combat support logistics, a methodology was 
developed for analyzing the transient behavior of a service system for a large population 
of modules under heavv traffic conditions where service policies with queue-length in- 
fluence are used. The modeling technique used a diffusion approximation valid for the 
heavy traffic conditions anticipated under combat conditions. The analytic solutions, 
which were obtained very quickly, were compared to simulation results and found to be 
very satisfactory. 

Alternative scheduling policies that reflect different organizational maintenance ser- 
vice disciplines can be readily compared. The model also provides a framework for 
choosing near-optimal spare module allocations within budget constraints. 

Besides starting the transient analysis from a known state (with zero Variance), the 
methodology 1s also applicable to initial conditions with arbitrary queue length mean 
and variance. For example, the model mav be used to analyze the response of the repair 
shop during a future transition from peacetime to combat conditions. In this case, the 
steady-state attained under peacetime conditions provides queue length mean and vari- 


ance initial conditions for the transient analysis under combat conditions. 


1. Further Research 
The combat support logistics models considered various repair shop disciplines 
and general service time distributions for a single server. An area for future research 
concerns extensions to multiple servers. 
The failure processes considered were for parts with individual Markovian fail- 
ures. The failure rates seen at the repair facility were proportional to either the total 


number of parts in the population less the number awaiting or undergoing repair, for the 
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repairman model, or the number of operational aircraft, for the aircraft detachment 
repairman model. In both situations, the probability of multiple failures in the interval 
(t, t+dr) is o(dr). 


Another area for future research concerns modeling the possibility of cat- 
astrophic failures which would cause group arrivals at the repair shop. Two situations 
are envisioned for group arrivals due to the Markovian occurrence of a catastrophic 
event. In the first situation, a catastrophic event causes either Zero or one item failure 
of each type simultaneously (1.e., given a catastrophic event in the interval (1, t+ dz), 
which occurs with probability 7, dt + o(dr), the number of items of type i which fail due 
to that catastrophic event is a Bernoulli random variable with parameter p, ). The cur- 
rent diffusion approximation model may be readily adapted to this situation. The sec- 
ond situation involves multiple failures of each type (1.e., given a catastrophic event at 
time 4, the number of items of type ¢ which fail due to that catastrophic event is a 
binomial random variable with parameters p, and n,=[K, — {s)} ). Preliminary work 
with this situation indicates that, for large svstems in heavy traffic, accurate results mav 
be obtained for the mean queue lengths using ordinary differential equations, but that 
the random fluctuations about the deterministic mean do not converge to a diffusion. 


Further research 1s needed to model catastrophic event failures. 
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APPENDIX A. PROTOTYPE VERTREP SEQUENCING PROGRAM 


*# * * *& * Variable definitions * * * * * 
* * Index usage: 
% Lifts 
¥ R Receivers 
¥ RSTAR Indes of optimal rcevr to get next lift 
* * Given data 
* TAU Expected value of time available 
% RCVRS Number of receivers 
¥ NCR) Number of lifts requested by rcvr R 
7% SOCR) Initial weapons state of rcvr R 
7 DELTA(R) Time for helo to deliver lift to revr R 
* RHOCR) Time for helo to return from revr R 
¥ SIGMACR) Time for revr R to strikedown a lift 
% ro) Single shot Pk of missiles on revr R 
ve Fei) Prob. attacker is engageable by revr R 
* * Other variables 
ve LSUM Total number of lifts requested 
vs SCR) Weapons state of revr R 
* SMAX(R) Maximum weapons state of revr R 
* CCR) Constant derived from given data 
vs PBAR(R) Derived constant (1-P(R)) 
% LWCV(R) Logistics Weighted Combat Value 
ws pee Maximum LWCV(R) 
woe ve * Variable declarations * * * % * 
REAL TAU, P(9) ,PI(9) ,DELTAC 9) ,RHO(9) ,SIGMA(9) 
REAL C(9), PBAR(9), peo LWCV(9) 
INTEGER R,L,RCVRS, LSUM,N(9) ,S(9) ,S0(9),SMAX(9),RSTAR 
wv ve * *% Initialize and read data * * *« * * 
READ(5 ,*)TAU,RCVRS 
LSUM=0 


DO 10 R=1,RCVRS 
READ(5.**)N(R) ,S0(R) ,DELTA(R) ,RHO(R) , SIGMA(R) , P(R) ,PI(R) 
LSUM=LSUMHN(R) 
S(R)=S0(R) 
SMAX(R)=S0(R)+N(R) 
C(R)=PI(R)*P(R)*EXP( -( DELTACR)+SIGMA(R) ) 
+ /TAU)/(1. -EXP( -(DELTAC(R)+RHO(R) ) /TAUV) ) 
PBAR(R)=1. -P(R) 
LWCV(R)=C(R)*PBAR(R)**SC(R) 
10 CONTINUE 
L=1 
ve tH x * % Main loop * * * * * 
DO 20 L=1,LSUM 
BEST=0. 
DO 30 R=1,RCVRS 
TFCSC(R) 2. SMAX( R ) BHEN 
IFC LWCV(R). GT. BEST) THEN 
RSTAR=R 
BEST=LWCV(R) 


lige 


wey 


ENDIF 
ENDIF 
30 CONTINUE 
WRITE(6,100)RSTAR 
SCRSTAR)=S(CRSTAR)+1 
LWCV( RSTAR)=C(RSTAR )*PBAR( RSTAR)**S( RSTAR) 
20 CONTINUE 
SOE 
100 FORMAT( 110) 
END 
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APPENDIX B. COMBAT VALUE 


In this appendix, the concept of combat value as a measure of the utility of ammu- 
nition to a Battle Group facing combat is discussed. The very simple combat model in- 
troduced in the prototype model of Chapter III is examined to provide insight into the 
characteristics that should be captured in a combat value function. And finally, a 


heuristic means to derive combat values is proposed. 


A. BACKGROUND 


1. Combat Value Concept 

As discussed in the introduction, the problem of rearming during combat in- 
volve objectives which should effectively combine combat objectives and logistics ob- 
jectives. The measures of effectiveness concerning logistics are inherently easy to define 
quantitatively, in easily understood units such as time, number of jobs, transportation 
cost, etc. The measures of effectiveness concerning combat are less easy to define 
quantitatively, and traditionally a variety of measures have been used to capture the idea 
of combat effectiveness in terms that are both useful and understandable to a rational 
decision maker. In the prototype model of Chapter III, a very simple combat model 
was introduced to quantitatively express total combat value as the probability of suc- 
cessful defense of the Battle Group. Each additional lift of ammunition provided a 
marginal increase in combat value. In that prototype problem, the objective function 
was an expectation of the total combat value accumulated before the replenishment 
process terminated due to the arrival of an attack. Another interpretation of the meas- 
ure of effectiveness is obtained using the terminology of job scheduling theory. As dis- 
cussed in Chapter IV, the total combat value of lifts completed prior to a raid arrival 
could also be thought of as the weighted number of jobs completed before their due date, 
where the due date is the arrival of a raid, and the weights are those same marginal 
combat values. In this respect, the objective function combines a measure of combat 
effectiveness with a measure of logistics effectiveness, specifically combat weights (or 


values) and numbers of jobs completed. 
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Defining the combat value function in the prototype model of Chapter III as a 
probability of successful defense was arbitrary. Another utility function could have been 
used to quantify the value of having some specified number of weapons available to the 


Battle Group when combat commences. 


2. Combat Value Terminology 

Suppose the Battle Group is in some depleted weapons state and anticipating 
combat. And suppose also that the Battle Group Commander could instantaneously 
(1.e., disregarding logistics considerations) increase the weapons state of the Battle 
Group by adding one J/iff of ammunition to one combatant. Implicitly, he will choose 
the lift that has the highest wzility to him for the ensuing combat. If his decision is based 
On improving the overall combat capability of the Battle Group, then the particular lift 
he will choose is the one said to vield the highest total combar utility. And since from a 
single lift , he is getting a marginal improvement in overall combat capability, that lift 
is the one with the highest marginal combat utility. If the concept of utility 1s quantified, 
then the measure of utility may be referred to as a weility value, or in this case marginal 
combat utility value, or simply marginal combat value. For example, if the ammunition 
loads in all ships in the Battle Group were depleted by approximately the same per- 
centage, then the Battle Group commander may prefer to add one SM2(MR) on an 
AEGIS cruiser rather than one SM1(MR) ona FFG-7, feeling that the former will have 


more utility in the ensuing combat. 


B. THE PROTOTYPE COMBAT VALUE FUNCTION 
The prototype combat model of Chapter III] provided a combat value function with 


the following properties: 


I. Weapon Effectiveness. The marginal combat value of a lift was an increasing 
function of its single shot probability of kill, which may be arbitrary, but is usually a 
measure of the combined effectiveness of the weapon round itself and the accuracy of 


the weapons direction system of the launching platform. 


2. Platform Effectiveness. The marginal combat value of a lift was an increasing 
function of the probability that the attacker is engageable by defender, which is deter- 


muned by the defensive function, and hence position, of the defender in the battle group. 
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3. Diminishing Returns. Total combat value was a concave function of the number 
of weapons already onboard each receiver. That is, the marginal combat value of an 
early lift is greater than subsequent lifts. This situation is usually referred to as dimin- 
ishing returns. This property of the model is consistent with intuition concerning Battle 
Group ammunition. For example, for two ships performing identical missions, the ten 
missiles it takes to bring one AEGIS cruiser’s missile load from 0 to 10 are worth more 
than the ten it takes to increase another AEGIS cruiser from, say, 70 to 80. That ex- 
ample is straightforward. As another example of the effect of diminishing returns, the 
Battle Group Commander may prefer to add one SM1({MR) on a FFG-7 that is down 
to 5 percent of its missiles, rather than one SM2(MR) on a much more capable AEGIS 
crulser that is at ninety-five percent. This example reflects the tendency of the Battle 
Group Commander to want a balance of some sort in how his assigned forces are 
loaded. 


4. Additivity. The marginal combat values of lifts to different receivers added to- 
gether. This property was a consequence of a simplifving assumption concerning the 
simple combat model of Chapter IV, which was required to allow the application of the 
interchange argument in sequencing. It was necessarv that the marginal combat values 
of lifts for each receiver not depend on the states of other receivers. That implied that 
the total combat value for the battle group was the sum of the combat values of the re- 
celvers (1.e., there were no cross terms in the Battle Group combat value function). In 
that model, the necessary condition was satisfied due to the assumption that attacker 


engageability by the defenders was mutually exclusive. 


C. COMBAT VALUE PRIORITY LIST METHOD 7 


1. Priority List 
Consider a Battle Group preparing to enter a combat situation. Conceptually, 
suppose that there was no ammunition currently aboard any of the ships, and ask the 
Battle Group Commander to make an expert assessment of the tactical situation and 
anticipated ammunition demand and to name the first unit of ammunition he would 
want in the Battle Group and which ship should have it. Next, have him idenufy the 
second unit, and so forth. In this manner, a priority list for every unit of ammunition 


in the Battle Group is generated, based purely on combat considerations. It may be 


he 


noted that this priority list can be considered as the ideal ammunition loading sequence 
if logistics factors are disregarded. 

The idea of this priority list method is that each item on the list has a higher 
marginal combat value than the next item on the list. How much higher remains to be 
discussed. To quantify these differences, a utility scale called combat potential is intro- 


duced. 


2. Combat Potential 

Combat potential is used as a measure of how effective a particular unit of am- 
munition is when available on a particular combatant. Combat potential could perhaps 
be quantified objectively using such factors as single shot kill probability, weapons sys- 
tem detection, acquisition and maximum engagement range, etc. However, in the fol- 
lowing, combat potential 1s assigned subjectively. 

Arbitrarily, combat potential 1s scaled so that the least capable weapon on the 
iowest value ship has a combat potential of 1, and other weapon-ship combinations are 
assigned combat potentials relative to that one. For example, if the least capable 
weapon on the lowest value ship (in an ASCM environment) 1s a 5”/38 gun on a frigate, 
then a lift of such ammunition for that ship has a combat utility potential of 1. Ifa 57/54 
gun on a destroyer is twice as good, then it has a combat utility potential of 2. If CIWS 
on a destroyer is twice again as good, then it has a combat utility potential of 4. And so 
forth. 


3. Calculation of Marginal Combat Values 
With the priority list and combat potentials established, marginal combat values 
of each of the units of ammunition is calculated in a simple way. The marginal combat 
value of the unit at the bottom of the priority list is set equal to its combat potential. 
Then proceeding up the priority list, the marginal combat value of each unit is increased 


above the previous (lower priority) unit by its own combat potential. 


4. Properties 
The marginal combat values calculated in the manner described above thus 
capture the basic idea of diminishing returns -- the units of ammunition at the top of the 
priority list (which conceptually are loaded when the Battle Group is nearly empty) have 
much higher marginal combat values than the units of ammunition at the bottom of the 


priority list (which conceptualiy are loaded when the Battle Group is almost full). 
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The priority list captures two more of the ideas discussed above. One is the idea 
of platform effectiveness, which is reflected in the tendency of the Battle Group 
Commander to give higher priority to those ships which he expects to bear the greatest 
burden in defending against the next raid. The other idea, which was discussed under 
diminishing returns, is that the distribution of ammunition in the Battle Group should 
be somehow balanced among the receivers. 

The combat potential captures the idea of weapon round and weapons system 
effectiveness discussed above. 

The additivity property of marginal combat value is inherent in the fact that 
once it 1s calculated, the marginal combat value of each unit of ammunition in the Battle 
Group 1s fixed, based on pure combat considerations, disregarding the logistics consid- 


erations which will play a part in the actual order in which each unit is loaded. 


5. Combat Value Priority List Method Outline 
The following steps, which will be illustrated in a subsequent example, outline 


a procedure for establishing marginal combat values by the Combat Value Priority List 
Method: 


Before Battle Groups are formed: 

]. Assemble basic data 
ID of combatants 
Tvpes of Weapons 
Capacities 

2. Assign Combat Potentials 

3. For each combatant (receiver): 
a. Prioritize every unit of ammunition. 
b. Sort by receiver priority number. 


When Battle Group is formed: 


4. For the entire Battle Group: 
a. Establish integrated BG priorities. 


is 
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b. Sort bv BG priority number. 
5. Calculate Marginal Combat Values 


6. Example 
In this example, for illustration of the heuristic Combat Value Priority List 
Method, a small Battle Group has three receivers, called ShipX, ShipY, and ShipZ. 
Within the Battle Group, there are six types of ammunition of interest, called Wep4A, 
WepB, WepC, WepD, WepE, and WepF. 
The receiving ships and types of weapons each carries are identified in 


Figure 42, along with the weapons capacities and assigned combat potentials for each. 


Receiver | Ammo Capacity Combat 
Type Potential 


ShipX 
ShipX 


RQ 
aS 


ShipY 
ShipY 
ShipY 


ShipZ 
ShipZ 
ShipZ 


me LON HRHOS 





Figure 42. Battle Group Ammunition Summary 


For each of the receivers, Figure 43a., b. and c., respectively, lists, by serial 
number, everv individual lift of ammunition carried on that receiver. The serial numbers 
are simply the order in which that receiver fills up that particular weapon magazine. In 
the last column of Figure 43a., b., and c., the lifts are numbered with receiver priorities, 
using the same idea discussed above for the overall Battle Group priority list. This is 
simply an intermediate step to pre-process ammunition lists for each receiver in prepa- 


rauon! assigning Battle Group priorities. The short list for ShipZ, Figure 43c., pro- 
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vides a good example of a priority list which is intended to build up a balanced weapons 
load for that receiver. 


Receiver Serial Combat Receiver 
Number | Potential | Priority 


! I 
Z 2 
3 3 
4 d 
. 5 
6 6 
7 8 
) My 
9 





Figure 43a. ShipX List by Ser. No. with Revr. Pri. Assigned 
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Receiver Ammo Serial Combat Receiver 
Type Number | Potential | Priority 


Se Si Oe ae 


Leo) bees Peng Penny Pong 





Figure 43b. ShipY List by Ser. No. with Revr. Pri. Assigned 


Receiver Serial _ Combat Receiver 
Number | Potential | Priority 


] 6 
2 6 
3 6 
“ 6 
] -| 
Z 4 
l l 
2 ] 
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Figure 43c. ShipZ List by Ser. No. with Revr. Pri. Assigned 


In next step, the individual receiver lists are sorted by receiver priorities and 
combined in a Battle Group list as shown in Figure 44. Then Battle Group priorities 


are assigned. 















Serial 
Number 


Receiver Ammo 
Type 










Combat 
Potential 


Receiver 
Priority 


Group 
Priority 
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= BAK ABA ASH & 





Figure 44. Group List by Revr. & Revr. Pri. with Group Pri. Assigned 
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Finally, the combined group list is sorted by Battle Group priority, and the 
marginal combat values are calculated, as described above, starting from the bottom of 


the list. The final list for this example is shown in Figure 45. 


D. JUSTIFICATION FOR A HEURISTIC 


In general, the combat value of a particular lift depends on many factors. Some of 
the factors are deterministic and some are stochastic. Examples of deterministic factors 
are: 

Quantity of ammunition currently onboard 


Ammunition design characteristics (including: warhead size, type of seeker, type of 
Mize sete 


Weapon System design characteristics (including: tvpe of guidance, type of radars, 
nuinber of directors, type of launcher, etc.) 


Battle Group formation 


The stochastic factors fall into several categories. Some stochastic factors are observable 
and distributional information may be inferred from data. For example: 


Weapons svstem performance (including: maximum effective range, maximum alti- 
tude, lethal radius, etc.) 


Weapons svstem degradations (including: failure rate, etc.) 


Environmental conditions which affect weapon system performance 


Some stochastic factors may not be directly observable, but may be subjectively esti- 
mated. For example: 

Raid time 

Raid size 

Raid composition 

Raid origin 


Threat axis 


And finally, some stochastic factors are dominated by such uncertainty that assumptions 
must be made to permit any type of modeling. For example: 


Planned raid tactics (including: grouping of attackers, coordination & sequence of at- 
tack (sub, surface, air), target priorities, etc.) 


Actual] battle dynanuics (including sequential decisions made in the face of unforeseen 
circumstances) 
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Figure 45. Group List by Group Pri. with Marg. Combat Values Calculated 


185 


The word “scenario” combines elements of many of these factors. Invariably, sce- 
narios are postulated which includes assumptions concerning raid tactics, roughly fixing 
raid variables which could be estimated (such as raid size: one, few, many), fixing other 
raid variables (such as threat axis and attack plan), and ignoring battle dynamics. 

Building general combat models quicklv leads to very high scenario dependency to 
account for important deterministic and stochastic variables, and which by their inherent 
complexity must use more and more assumptions. Because realistic analytic combat 
models become too complex and scenario dependent, simulation and wargaming are in- 
variably resorted to for complex combat scenarios. However, a simplified analvtic 
combat model which may not capture all the fine-grained detail of a real problem may 
by its simplicity provide important insight into the general behavior of a process being 
modeled. 

Thus the approach used in this study has been to use the highly simplified combat 
model of Chapter II] to analytically identify the properties of a combat value function, 


and then use a heuristic method to capture more realistic considerations. 
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APPENDIX C. PERT REPRESENTATION OF TRANSFER TIMES 


This appendix contains the details of how a replenishment transfer may be repres- 
ented as a PERT type system; see, for example, Elmaghraby [Ref. 23]. For simplicity, 
this discussion will consider the process of VERTREP of a single commodity from a 
delivery ship to a single receiver bv one helicopter. Extension to multiple receivers, 
weapons, and helicopters is simply a matter of additional subscripts on several of the 
variables. All times are deterministic. 

Following PERT terminology, the word activity will be used for the various portions 
of the replenishment process which take place over an interval of time, including break- 
out, helicopter travel, and strikedown. The word event will be used to mark the instant 
in time at which an activity starts or finishes. For clarity, multi-letter variable names 
Will be used in this description. Variables which represent event times will be prefixed 
with E and variables which represent the time it takes to conduct an activity will be 


prefixed with 7. Let the index ¢ denote the sequence in which lifts are transferred. 


A. ACTIVITY TIMES 


Let the following variables denote the corresponding activity times: 


Tb, Time it takes the delivery ship to process (break out) the 7 lift. 
joy, Time it takes the receiving ship to process the # lift. 

foe lime it taxes the helicopter to get thicuuialift. 

Time it takes the helicopter to drop off the i lift. 


Tvo, Time it takes the helicopter to travel out from the delivery ship to the re- 
ceiver with the 7” lift. 


Tvi, | Time it takes the helicopter to travel in from the receiver to the delivery 


ship after dropping the /* lift. 


Delivery ship processing activity time includes the time it takes to remove items from 
storage, package items into a ready-for-transfer lift, and stage the lft for pickup by the 


helicopter. 
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Receiver processing time includes the time to un-package the lift, and make items 
from the lift ready for use. Collectively, these activities are part of the total time it takes 
a receiver to complete strikedown. The other part, which is not included in Tr; is any 
time that the lift spends in a strikedown queue. 

The time it takes a helicopter to get a lift includes the fixed time for the helicopter 
to maneuver into pickup position, pick up the staged lift from the delivery ship, and start 
moving towards the delivery ship. This fixed tme 1s exclusive of variable flight time 
flying from the delivery ship to the receiver. 

The time it takes a helicopter to drop off a lift includes the fixed time for the heli- 
copter to maneuver into drop off position and actually make the drop. This also 1s ex- 
clusive of variable flight time. 

The helicopter travel times are variable due to the relative speeds of the receiving 
ship, delivery ship, and helicopter, and the distance the helicopter must travel each di- 


rection. 


B. EVENT TIMES 


Let the following variables denote the corresponding event times: 


Eb, Event time when the delivery ship has completed breakout of the é lift. 
Ed, — Event time when the helicopter is dispatched with the / lift. 
Eh, | Event time when the helicopter has dropped off the i lift. 


ES, Event time when the receiver has completed strikedown of the /* lift. 


jhe Event time when the helicopter has returned from dropping off the ¢ lift. 
1. Recursive Calculation of Event Times 

The event times may be calculated recursively. The event which marks the time 

when the deliverv ship has completed breakout of current lift is the length of the current 

lift breakout activity time added to the time when the previous lift breakout was com- 


plete, as follows: 


Eb; — Eb,_, =F Tb; 
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A helicopter may be dispatched at the latter of its return from a previous lift or 


breakout completion of the current lift, plus the fixed time it takes the helicopter to pick 
up the lift, as follows: 


Ed; = Tg; + max [Eb,, Er,_,] 


The time at which a lift is dropped off at the receiver is the sum of the time of 


dispatch plus variable flight time to the receiver plus the fixed time to drop off the lift, 
as follows: 


Eh; = Ed; + T vo; + Th, 


The event which marks the time of strikedown completion is the length of the 
current lift strikedown activity time added to the latter of the previous strikedown com- 


pletion event or the current lift drop off time, as follows: 
Es; = Tr, + max [Eh;. Es,_,} 


The event which marks the helicopter’s return from the current round-trip and 
readiness to pick up the next lift is the variable flight time returning added to the event 


time When the current lift was dropped off, as follows: 


Er; = Eh; ate Tvi; 


2. PERT Diagram Representation 
A segment of a PERT diagram representation corresponding to the computa- 
tions given above is shown in Figure 46. The large circles represent the VERTREP 
events, and the solid arrows represent the VERTREP activities. The small circles and 
the dashed arrows are dummy events and activities which are used to represent preced- 


ence on a PERT network. 
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Figure 46. PERT Diagram Segment 


3. Initialization 
If all replenishment activity starts at time zero with no lifts waiting to be proc: 


essed, event times are initialized as follows: 
Eb, = 1b, 
Ed, = Tg, + Eb, 
Eh, = Ed, + Tvo, + Th, 
Es, = Tr, + Eh, 


Er, — Eh, + Tvi; 
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APPENDIX D. BATTLE GROUP VERTREP EXAMPLE 


This appendix contains the tables pertaining to the example of a Battle Group 
combat VERTREP problem discussed in Chapter III. 


Table 6. BATTLE GROUP AMMUNITION SUMMARY (COMBAT VALUE 


INPUT) 
Receiver Ammo Capacity Combat 
Type Potential 
Shipl WepA 40 20 
Shipl WepD + 4 
Shipl WepE ~ 4 
Shipl WepF 20 2 
Sship2 WepB 20 10 
Ship2 WepD Z 4 
Sship2 WepE 2 4 
Ship2 WepF 10 2 
Ship3 WepC 8 6 
Ship3 WepD 2 4 
Ship3 WepE 2 4 
Ship3 WepF 20 Z 
Ship4 WepC & 6 
Ship4 WepD 1 4 
Ship4 WepE 2 4 
Ship4 WepG 10 i 
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Table 8. SHIP2 LIST BY SER. NO. WITH RCVR. PRI. ASSIGNED 


Receiver Ammo Serial Combat Receiver 
Type Number Potential Priority 
Ship2 WepB i 10 
Ship2 WepB 2 10 
Ship2 WepB 3 10 
Ship2 WepB 4 10 
Ship2 WepB 5 10 
Ship2 WepB 6 10 
Ship2 WepB 7 10 
Ship2 WepB 8 10 
Ship2 WepB 9 10 
Ship2 WepB 10 10 
Shia D2 WepB WSL 10 
Ship2 WepB eZ 10 
Ship2 WepB i 10 
Ship2 WepB 14 10 
Ship2 WepB 15 10 
Ship2 WepB 16 10 
Ship2 WepB 17 10 
Ship2 WepB 18 10 
Ship2 WepB 19 10 
Ship2 WepB 20 10 
Ship2 WepD ik 4 
Ship2 WepD 2 4 
Ship2 WepE 1 4 
Ship2 WepE 2 4 
Ship2 WepF 1 2 
Ship2 WepF 2 2 
Ship2 wepF 3 Z 
Ship2 WepF 4 2 
Ship2 WepF 5 Zz 
Ship2 WepF 6 2 
Ship2 WepF i 2 
Ship2 WepF 8 2 
Ship2 WepF 9 2 
Ship2 WepF 10 Zz 
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Table 11. 
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Receiver Ammo 
Type 
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Table 12. GROUP LIST BY GROUP PRI. WITH MARG. COMBAT VALUES 


CALCULATED 
Receiver Ammo Serial Combat Receiver Group Marg. 
Type Number Potential Priority Priority Combat 
Value 
Shipl WepA 20 1 1 i 1258 
Shipl WepA 20 2 2 2 12358 
Shipl WepA 20 5 s) 3 1218 
Shipl WepA 20 4 4 4 r198 
Ship2 WepB 10 iL i 5 78 
Shipl WepA 20 5 = 6 1168 
Shipl WepA 20 6 6 7 1148 
Shipl WepA 20 7 i 8 1128 
Shipl WepA 20 8 8 2 1108 
Ship2 WepB 10 2 2 10 1088 
Shipl WepD 4 i 9 11 1078 
Shape WepD 4 i 5 2 1074 
Ship3 WepC 6 a iL 13 1070 
Ship4 WepC 6 i iL 14 1064 
Shad WepA 20 9 1 ie 1058 
Shipl WepA 20 10 i 16 1038 
Ship2 WepB 10 3 3 Ly 1018 
Ship3 wepC 6 2 2 18 1008 
Ship4 WepC 6 Z Z Ws, 1002 
Shipl wepA 20 1 13 20 996 
Shipl WepA 20 Le 14 21 976 
Shiae2 WepB 10 - “ oe £26 
Shipl WepE 4 1 10 Z3 946 
Ship2 WepE 4, 1 6 24 942 
ships WepD 4 1 3 Zo 938 
Ship4 WepD 4 1 5 Z6 934 
Shipl WepA 20 be) GS, ome o50 
Shipl WepA 20 14 16 28 910 
Ship2 WepB 10 5 7 29 890 
Ship2 WepB 10 6 8 30 880 
Ship3 WepC 6 3 4 31 870 
Ship3 WepC 6 4 5 SZ 864 
Ship4 WepE 4 if 4 a 858 
Shipl WepA 20 15 17, 34 854 
Shipl WepA 20 16 is 35 834 
Ship2 WepB 10 7 g 36 814 
Ship3 WepE a 1 6 37 804 
Shipl WepD 4 Z 19 38 800 
Ship2 WepB 10 8 10 a9 796 
Sship3 WepC 6 5 7 40 786 
Ship4 WepC 6 3 5 41 780 
Shipl WepE 4 Z 20 42 774 
Ship2 WepB 10 9 al 43 770 
Shipl WepA 20 7 aa 44 760 
eigusto)-l WepA 20 18 a Ji 45 740 
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Table 13. RECEIVER AMMUNITION REQUESTS (LOGISTICS INPUT) 


Ammo 
Type 


WepA 
WepB 
WepC 
WepD 
WepE 
wepF 
WepG 


Break- 


out 
Time 


he 
15 
ee 
era 
. 08 
ea 
- 10 


Helo 


Pickup 


Time 


. 03 
O02 
Og 
02 
- 02 
08 
/ 03 
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Helo 


Dropoff 


Time 


02 
02 
O02 
02 
O02 
02 
~ O2 


Strike- 

Receiver Ammo down Capacity Weapon Lifts 
Type Time State Req. 

Shipl WepA 0-50 40 10 30 
Shipl WepD 0.10 4 ii é) 
Shipl WepE 0-20 4 2 S) 
Shipl WepF 0.15 20 15 5 
Ship2 WepB On25 20 S lls, 
Ship2 WepD 0.10 2 1 1 
Ship2 WepE OFZzG 2 1 1 
Ship2 WepF els: 10 4 6 
Ship3 WepC 0220 8 Z 6 
Ship3 WepD 0.10 2 0 2 
Ship3 WepE 0. 20 2 0 2 
Ship3 WepF O.13 20 10 10 
Ship4 WepC Oe 220 4 0 4 
Ship4 WepD 0.10 I 0 1 
Ship4 WepE 0226 2 0 2 
Ship4 WepG Os 10 4 6 

Table 14. AMMUNITION DELIVERY DATA (LOGISTICS INPUT) 


Xin 2 o/ 


Table 15. BATTLE GROUP MANEUVERING DATA 


Receiver Shipl Ship2 Ship3 Ship4 

Initial Range 30 5 15 § 

Relative Closing 30 20 25 25 
Speed 

Final Station 5 30 3 15 

Required on-station 8 8 8 8 
Time 

Relative Opening 20 30 25 Zs 
Speed 

Helo Relative 110 90 105 95 


Delivery Speed 


Helo Relative 90 110 OS 105 
Return Speed 
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Table 16. INITIAL VERTREP SCHEDULE - LWCV HEURISTIC 


Marginal Strike- 


sequence Dispatch Receiver Weapon Combat down 
Number Time Value Compl. 
1 Spal Ship4 WepE 858 mos 
2 a alk Ship4 WepD 934 253 
3 pee) Ship4 WepC 1064 eS 
4 »45 Ship4 WepC 1002 ie, 
5 55 Sship3 WepD 938 68 
6 .63 Ship3 WepE 804 .85 
7 es. Ship3 WepC 870 oy 
8 87 Ship3 WepC 864 1.17 
9 a)S) Shipl WepE 774 1 ans 
10 1g.05 Shipl WepD 800 7 
11 thes ahs} Ship4 WepE a3 35 
12 25 Sship3 WepC 786 1.47 
13 T37 Ship4 WepC 780 i 
14 1.49 Ship3 WepC 720 it. 71 
iL 1.64 Ship2 WepB 880 io 
16 30 Shipl WepA 996 Die 32 
17 2 Ship4 WepC 661 2.14 
18 207 ship2 WepB 814 2.34 
19 23 Shipl WepA 976 2. 62 
ZO PEDO IS) Ship3 WepC 631 ea) 
21 20 Ship2 WepB 796 2a 7 
22 2.66 Shipl WepA 930 B. 32 
23 Zeer Shipl WepE 403 2.96 
24 Is ole, Ship2Z WepB 770 516 
25 3.05 Shipl WepA 910 3, 82 
26 Dy VIeS) Ship3 WepE Sieh, Crue) 
27 A) ship3 WepD 431 335 
28 3. 39 Shipl WepA 854 4. 32 
29 3.54 Ship2 WepB 673 5), tail 
30 3.64 Shipl WepD 407 gn 6 
31 3. 80 Shipl WepA 834 4.82 
52 Seb) Ship2 WepB 565 ieee 
33 4.07 ship3 WepC 457 4.29 
34 4.23 Shipl WepA 760 Deo. 
30 4.38 Ship2 WepB 355 4.65 
36 4.54 Shipl WepA 740 Se 82 
oy 4.70 Shipl WepA 713 6352 
38 4.86 Shipl WepA 693 6,62 
39 a0 1 Ship2 WepB ye) Sa26 
40 Sly Shipl WepA 653 732 
41 Samo Ship2 WepB 383 Sy be 
42 5. 48 Shipl WepA 625 TO? 
43 ag Ship2 WepD 210 5. 70 
44 5.74 Sl akjeya WepA 605 5.32 
45 eyenoy) Shap WepB 310 6. 16 
46 6.05 Shipl WepA 575 8.2 
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47 
48 
49 
20 
Slt 
2 
ais 
54 
55 
56 
7 
28 
Sy, 
60 
61 
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72 
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a6 


~45 
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n2 6 
7) 
5 ay 
sali 
Bp: 
64 
a9 
-44 
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OU 
gil 
. 86 
14. 
OW 
02 
eo 
si 9 
.14 
ao 
~45 
00 
fen 
. 06 
e722 
oy 
13: 


an 


69 


Ship2 
Shipl 
Ship2 
Shipl 
Shipl 
Shipl 
Shipl 
Shipl 
Shipl 
Shipl 
Shipl 
Shipl 
Ship3 
Shipl 
Shipl 
Ship3 
Shipl 
Ship3 
Shipl 
Ship3 
Shipl 
Shipl 
Ship3 
Ship2 
Shipl 
Ship3 
Shipl 
Ship2 
Ship4 
Ship3 
Shipl 
Ship2 
Ship4 
Ship2 
Shipl 
Ship3 
Shipl 
Ship4 
Ship2 
Shipl 
Ship3 
Ship2 
Ship4 
Ship2 
Ship2 
Shipl 
Ship3 
Ship4 
Ship2 
Ship2 
Ship4 


EXPECTED COMBAT VALUE 
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WepE 
WepD 
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WepA 
WepA 
WepA 
WepF 
WepA 
WepA 
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WepA 
WepF 
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WepF 
WepA 
WepA 
WepF 
WepB 
WepA 
WepF 
WepA 
WepB 
WepG 
WepF 
WepF 
WepB 
WepG 
WepB 
WepF 
WepF 
WepF 
WepG 
WepF 
WepF 
WepF 
WepF 
WepG 
WepF 
WepF 
WepF 
WepF 
WepG 
WepF 
WepF 
WepG 


260 6. 
Doo ee 
124 6 
See, 9 
499 10 
106 i 
120 y 
479 AO). 
451 se 
427 PM. 
7 Z 128 
5) iz; 
50 8: 
330 13; 
300 13% 
46 8. 
280 14. 
40 S 
250 14. 
35 or 
230 MS) 
206 13) 
28 oi. 
164 1G: 
184 16. 
24 TOE 
154 16. 
134 Tike 
64 Ide 
20 1 
26 lide 
116 1s 
53 2 
102 1S 
ae 12 
16 13. 
18 13; 
38 14. 
70 14. 
14 lo 
10 LS: 
59 1S 
Sia To. 
44 1G. 
a2 1% 
ii Ive 

3 le 

8 18. 
i 15: 
., 13. 

i Loe 

= 17336. 
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32 
82 
03 
a2 
82 
33 
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a2 
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80 
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a 
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64 
20 
66 
80 
O04 
56 
ad 
70 
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Table 17. 2-OPT VERTREP SCHEDULE - LOCAL NEIGHBORHOOD 
SEARCH 


Marginal Strike- 


Sequence Dispatch Receiver Weapon Combat down 
Number Time Value Compl. 
1 = Ship4 WepE 858 oie, 
2 el Ship4 WepD 934 a: 
3 . 3 Ship4 WepC 1064 5D 
4 -41 Ship3 WepE 804 mo? 
5 oe, Ship4 WepC 1002 aes 
6 nos Ship3 WepD 958 5 es 
i » Ship3 WepC 870 7 
8 Belt ship! WepA 996 1.45 
2 00 Shipl WepE 774 iB. 22 
10 1.09 Shipl WepD 800 Wee 1 
ia ee 1 Ship3 WepC 864 143 
12 29 Ship4 WepE Soe Tego 1 
13 1.45 Ship WepA 976 197 
14 eS) 7! Ship3 WepC 786 I, HE, 
15 7 Shipz WepB 880 99 
16 Me ere Shipl WepA 930 2.47 
7 2.00 Ship4 WepC 780 Zed 
18 2.12 Ship3 WepC VPAO) 2.34 
ue oe? Ship2 WepB 814 2.54 
20 2.43 Shipl WepA 2) 10) yan EN 
taal 2S > Ship4 WepC 661 lie | 
Ze Ze? 0 Ship2 WepB 796 2297 
5) Zz. 60 Shipl WepA 854 3.47 
24 22.9.5 Ship3 WepC 6o1 2220 
15, 3. 06 Shipl WepE 403 3428 
26 S02 1 Ship2 WepB 770 3.48 
27} S. 29 Ship3 WepE 389 ciel 
28 3.45 Shipl WepA 834 5297 
29 3) oe) Ship3 WepD 431 S307 
30 B70 Ship2 WepB 673 ey, 2 
ol 250 Shipl WepD 407 Bo Ss 
a2 3\, ele Shipl WepA 760 4.48 
55 4.11 Ship2 WepB 585 4.38 
34 4,23 Ship3 WepC 457 4.45 
35 4.39 Shipl WepA 740 4.98 
36 4.54 Ship2 WepB 535 4.81 
shy 4.64 Ship2 WepD 210 4.76 
38 4.79 Ship2 WepB Se, 5.06 
a, 4.95 Shipl WepA UALS 5.48 
40 See, Ship2 WepB 383 SY 
41 a2) Ship2 WepB 310 DHO2 
42 5.41 Shipl WepA oe 5eo5 
43 5.49 Ship2 WepE 124 By 
44 5.64 Ship2 WepB 260 Seed 1 
45 Shey, Ship2 WepB 164 6.16 
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Snips 
Shipl 
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Ship3 
Shipl 
Sship3 
Shipl 
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Shipl 
Shipl 
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Sip 
ship3 
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. 80 
E95 
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A Oe 
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BLS. 
Tae 
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Tae 
Ey 
15. 
ley, 
EXPECTED COMBAT VALUE = 17871. 
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Table 18. 3-OPT VERTREP SCHEDULE - LOCAL NEIGHBORHOOD 
SEARCH 


Marginal Strike- 


Sequence Dispatch Receiver Weapon Combat down 
Number Time Value Compl. 
1 PL Ship4 WepE 858 ieee fe) 
ie po Ship4 WepD 934 oo3 
3 gee! Ship4 WepC 1064 bo ps) 
4 ~41 Ship3 WepE 804 Ol 
5 ~53 Ship4 WepC 1002 sy hs 
6 HOS Ships WepD 938 275 
7 Pe Ship3 WepC 870 97 
8 ES | Shipl WepA 996 1.45 
9 00 Shipl WepE 774 ce 
10 O09 Shipl WepD 800 ieee | 
hal tf. 21 Ship3 WepC 864 1.43 
12 eS 7 Shipl WepA 976 - 95 
13 1.49 Ship3 WepC 786 Fea? L 
14 Te oul Ship4 WepC 780 Ihe (358) 
15 1.76 Ship2 WepB 880 7A, 10%) 
16 92 Shipl WepA 930 245 
17 ZO Ship4 WepE 523 J, Pap 
18 Zhe Ship3 WepC 720 2.34 
19 227 Ship2 WepB 814 2.54 
20 2.43 Shipl WepA 910 2.95 
7a 5 Ship4 WepC 661 2.77 
22 Ze 0 Ship2 WepB 796 Zea d 
25 278 Shipl WepE 403 3.00 
24 2.94 Shipl WepA 854 3.46 
25 B06 Ship3 WepC 631 3.28 
26 pee | Ship2 WepB 720 3.48 
ag | Bo. 29 Shap WepE oe) oa 1 
28 3.45 Shipl WepA 834 Sod 
US 3.55 Ship3 WepD 431 oe o/ 
30 3.70 Ship2 WepB 673 32 9/ 
5 Cr o10) Shipl WepD 407 © 
32 3.96 Shipl WepA 760 4.48 
33 4,11 Ship2 WepB 585 ee Site! 
34 4,23 Ship3 WepC 457 4.45 
35 4.39 Shipl WepA 740 4.98 
36 4.54 Ship2 WepB ao5 4,81 
co 4,64 Ship2 WepD 210 4,76 
38 4.79 Ship2 WepB Behe, 5. 06 
oH) 4.95 Shipl WepA p13 5.48 
40 SiO Ship2 WepB 383 eo / 
41 Say a: Ship2 WepB 310 S262 
42 5.41 Shipl WepA 693 5298 
43 5.49 Ship2 WepE 124 Sra? 4 
44 5.64 Ship2 WepB 260 Sl 
45 Dre Shipl WepE 106 5.94 
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EXPECTED COMBAT VALUE = 17882. 
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APPENDIX E. CONREP SCHEDULING DYNAMIC PROGRAM 


A. PROGRAM LISTING 


OE ee ee = Mi pT. 
i Variable Definitions 

* Index usage 

* J! Receivers 

% K Lift number 

¥ R Stages 

% S States 

* IS Ith state in stage 

ve JS Receivers in state § 

% RC Stage complement 

ve RM Stage minus 1 

" SC State complement 

¥ SM State minus receiver 

* Coding of states and receivers (DATA statements) 

* JID( 3) Revr J Identity (binary code) 

¥ LRS(1j,s) List of receivers in state s 

% SR(ls,r) List of possible states in stage r 

* SRTOP(n) Top state number with n receivers 

* TOPS Top state number = SRTOP(n) 

* Input Data 

¥ NRCVR Number of receivers 

* ETA Expected attack time Ta 

v NLC j) Total number of lifts req. by Revr j 

* CVC 4,k) Marginal’ C. Vaotslatt hk onmicvrs) 

w X( j,k) Transfer comp. time of lift k on Revr } 
ve CC he) Strikedown comp. time of lift k on Revr 3 
* Derived Values 

¥ ATNR Neg. recip. of Exp. attack time = -1 / ETA 
¥ CCV( j,k) Cumulative CV of k lifts on Revr j 

* FBARX(4,k) Prob. X(j,k)>Ta 

* Stage Variables 

a FRS Test Expected CV in state s at stage r 
* FOPT(r,s) Optimal Expected CV in state s at stage r 
7% JOPT(r,s) ID of Optimal Rcvr in state s at stage r 
* KOPT(x,s) Optimal Lifts token JOrtGr.s) 

7% XOPT( r,s) Optimal Time allotted to JOPT(r,s) 

* Partition Variables 

* FP Test Partition Expected CV 

% PRORT Opt. Partition Expected CV 

* R10PT Opt. Stage for Deliver side l 

* R20PT Opt. Stage for Deliver side 2 

* S10PT Opt. State for Deliver side 1 

¥ 520PT Opt. State for Deliver side 2 


vis ewrewwrewewewewwewewrwewewrewrwmermrewrewrerq@derwrwwrwmewrwrwmerermermewerweevwouwoewewewowoerwoereraewewae@waeraeeFewe 2 @@2 ae @ & 
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One 


“i 


= 
as 


as 


Variable Declarations 
INTEGER J,R,S,;JS,1S,K,RM,SM,RE {SC NRGVRRR Lae 
~ JID( 4) ,SRTOP( 4), TOPS, LRS( 4515) (Seh6@674) (NSK(4 2 
+ JOPT(4,15) ,KOPT(4, 15) ,RICPRARZOPT siICEs. 20a 
REAL ETA,ATINR,CV(4,50) ,C(4, 500, 4(4 sO mec cao Soe 
+ FBARX(4,50),FRS,FOPT(4,15) ,XOPT( 4,15) ,FPOPT,FP 


cccceere-- initialization ©9<°--<+-"sge0+-===se0 20> == =e 
DATA (CCV(J,0),J=1,4) /4*0. / 
DATA R20PT /0/ 
DATA S20PT /0/ 
ecccee- coding of states and receivers -<--------cce=cee=- 
DATA JID /1,2,4,8/ 
DATA SRIOP /1,3,7 ye) 
DATA NSR /4,6,4,1/ 
i list of possible states in each stage -rer--9c----- 
DATA (SR(S,1),S5=1,4) /1,2,4,8/ 
DATA (SR(S,2),S=]196) 07 3,5 Gy omen 2/7 
DATA (SR(S,3) ,S=1,4)87 7,11 ae, 
DATA (SR(S,4),S=1,1) /15/ 


eoreeee list of Receivers in each state rcrrrrcrres-e-e--- 


DATA LRS(1, 1) /1/ 
DATA LRS(1, 2) Py) 
DATA LRS(1, 4) ay 
DATA  LRS(1, 8) /4/ 


DATA. CLRSCJ, 3), Jalen 2a 
DATA CIRSCJ, 5),J=Ieoe oo 
DATA (LRS(J, 6),J=1,2) /3,2/ 
DATA (LRS(J, 9),J=1,2) /4,1/ 
DATA (LRS(J,10),J=1,2) /4,2/ 
DATA (LRS(J,12),J=1,2) /4,3/ 
DATA (LRS(J™ 7),J=1,3) /3yoe7 
DATA (LRS(J,11),J=1,3) /4,2,1/ 
DATA (LRSCJ,13),J=1,3) /4,5007 
DATA (LRS(J,14).J=1,39)) (4,002) 
DATA (LRS(J,15),J=1,4) /4,3.2.1/ 


6 Read Input Data --e-e-ce-eeereere--- 
READ(5 ,*)NRCVR 
TOPS = SRTOPCNRCVR) 
READ(5 ,*)ETA 
ATNR = -l. / ETA 
DO 10 J=1,NRCVR 
READ(5,*)NL(J) 
DO 11 K=1,NL(J) 
READ(5,*)CVGI, Kya io Clan) 
1 CONTINUE 
10 CONTINUE 


DO 50 J=1,NRCVR 
DO 51 K=1,NL(J) 
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J¢ 


Fis 


Sil 
50 


90 


130 
120 
110 


COV(J,K) =CCV(J,K-1)+CV(J,K)*EXP(C(J,K)*ATNR) 
FBARX( J ,K)=EXP(X(J,K)*ATNR) 
CONTINUE 
CONTINUE 


ae a eee = Stage r=l -------------------------- 
DO 90 J=1,NRCVR 
EORTGr, JID(J))=— CCVC J, NLGD 
JOPTEL, JID J) ye= J 
KOERGE, JID(I))e= NL(J) 
AGEL GE, JID( J) j= XJ ,NL( Jp 
CONTINUE 
a = = ai Stage r=2,NRCVR -----e-rere ener ene- 


DO 100 R=2,NRCVR 
RM=R-1 
*%*%* for each state in this stage 
DO 110 IS=1,NSR(R) 
S=SR(IS,R) 
iBCSeGT. TORS 60 TO 161 
wore initialize maximization 
FOPT(R,S)=0. 
JOPT(R,S)=0 
KOPT(R,S)=0 
XOPT(R,S)=0. 
wie for each receiver in state § 
DO 120 JS=1,R 
J=LRS(JS,S) 
SM=S -JID( J) 
wee for each lift requested by revr J 
DO 130 K=1,NL(J) 
FRS=CCV(J,K) + FOPTCRM,SM) * FBARX(J,K) 
IFCERSsGT. FOr Rtkwo eure 
FOPT(R,S)=FRS 
JOPT(R,S)=J 
KOPT(R,S)=K 
XOPT(R,S)=X(J,K) 
ENDIF 
CONTINUE 
CONTINUE 
CONTINUE 
CONTINUE 
CONTINUE 


HO SOS S 2S SSE it ta 2 ee en ee = = = = = 
R10PT = NRCVR 

S10PT = TOPS 

FPOPT = FOPT(R10PT,S10PT) 

ower ees esereces- Stage r=], PRONRGVR/ 26 o--------- 


DO 300 R=1,NRCVR/2 
RC = NRCVR - R 
wk for each state in this stage 
DO 310 IS=1,NSR(R) 
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Va Vm. / 


310 
S16) 
300 


210 


S = SRCIS,R) 
TFS: Gi Ors) CO) nO 
SC = TOPS - § 
FP = FOPT(R,S) + FOPT(RC,SC) 
{PCF ERG is POPs) tiny 
FPOPT = FP 
RIOEm 
SLOnd 
R20PT 
S20RT 
ENDIF 
CONTINUE 
CONTINUE 
CONTINUE 
wor cceceene-- Output schedule ----eree- enc ee cere en-- 
WRITE CGR 9702) 
WRITE(CO,O9905) 
S=S10PT 
DO 210) R=RIOPi 1-1 
WRITE(6 , 99910) JOPICK SS) Shoe tenes). Or netn os) 
S=S -JID( JOPT(R,S}) 
CONTINUE 
WRITE(6, 99902) 
WRITE( 6, 99905) 
S=S20PT 
DO. 220 -R=KZ0F P15 -1 
WRITEC6, 99910) JOPICR, S)RROPTCK Se. Cr TGs) 
S=S-JIDC JOPT(R,S)) 
CONTINUE 


tS |e | 
WM Dw 
qa 


- "semen ~~ <-s>5— formats Goa ee eae aS a Sees eee a sicia 
FORMAT(' Delivery side 1: ') 

FORMAT(' Delivery side 2: ') 

FORMAT( ' Receiver Number of Lifts Time Alongside’ ) 
FORMAT(5X%,13;12%, 13 315347 
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B. INPUT FILE 


4 NRCVR Number of receivers 

4, ETA Estimate of expected time between raids 

41 NL( 1) Number of lifts requested by receiver 1 
996; 0. 16 0. 66 Shipl WepA 
70. OF28 16 Shipl WepA 
800. 0.40 0.50 Shipl WepD 
774, O52 OZ Shap! WepE 
2h). 0), 0.64 lcs Shipl WepA 
910. 02.76 2.16 Shipl WepA 
854. 0. 88 2.66 Shipl WepA 
834, 1. 00 3. 16 Shipl WepA 
760. eZ 3. 66 Shipl WepA 
407. 1.24 1.34 Shipl WepD 
403. io 12356 Shipl WepE 
740. 1.48 4.16 Ship1l WepA 
(INSP 1.60 4.66 Shipl WepA 
693. ere 5.16 Shipl WepA 
653. 1.84 5. 6c Shipl WepA 
625. 1 Sle Go. IG Shipl WepA 
605: Zr 08 6. 66 Shipl WepA 
DS: 2.20 thy Ne Shipl WepA 
S56 Ze 32 7. 66 Shipl WepA 
519, 2.44 8.16 Shipl WepA 
20: 256 2. 66 Shipl WepD 
499, Nays: 8. 66 Shipl WepA 
106. 2. 80 3. 00 Shipl WepE 
479, Ze 9Z 9.16 Shipl WepA 
451. 3.04 9. 66 Shipl WepA 
427. 5.16 2G Shipl WepA 
See B26 . 66 Shipl WepA 
Boe. 3.40 . 16 Shipl WepA 
330. no 2 . 66 Shipl WepA 
300. 3. 64 hG Shipl WepA 
280. Sans) . 66 Shipl WepA 
26. 3.88 .03 Shipl WepF 
(08 4.00 . 16 Shipl WepA 
Zee a, 12 27 Shipl WepF 
250: 4.24 . 66 Shipl WepA 
Z0G. 4. 36 nals: Shipl WepA 
18. 4.48 O32 Shipl WepF 
184. 4,60 . 66 Shipl WepA 
14. 4.72 a7 Shipl WepF 
154. 4.84 . 16 Shipl WepA 
rE 4.96 ys ial Shipl WepF 

NL(2) Number of lifts requested by receiver 2 
880. We 16 0.41 Ship2 WepB 
814, 0.28 0. 66 Ship2 2 WepB 
Woh 0.40 0.91 Ship2 3 WepB 
770; Oicd2 als: Ship2 4 WepB 
oy Sie 0. 64 1.41 Ship2 5 WepB 
Door 0. 76 1366 ShaipZ 6 WepB 
Door 0. 88 abe pA Shap2 ii WepB 
399. Le On, 2216 Ship2 8 WepB 
36s. Lak? 2.41 Ship2 9 WepB 
S10; 1.24 2106 Ship2 10 WepB 


\7 mn. 6/ 


2105 1. 36 1. 46 Ship2 Me WepD 
260. 1.48 Zo 1 Ship2 2. WepB 
124. 1. 60 1. 80 Ship2 i WepE 
164. ey 2 3.16 Ship2 14 WepB 
134, 1.84 3.41 Ship2 15 WepB 
116; ie SIE 3.66 Ship2 16 WepB 
70. 2-06 Zu23 Ship2 17 WepF 
0p 2.20 Shee) IL Ship2 18 WepB 
eel. 2, 32 2.47 Ship2 ig WepF 
44, 2.44 ZO? Ship2 20 WepF 
33) 2.56 Pip IEE! Sship2 YAN WepF 
25 2.68 Zee Ship2 Jag) WepF 
2. 80 3: 07 Ship2 23 WepF 
20 Number of lifts requested by receiver 3 
OS Gr 0.16 0. 26 Ship3 1 WepD 
870. 0.28 0.48 Ship3 2 WepC 
864. 0.40 0.68 Ship3 3 WepC 
804. Obes 4 O72 Ship3 4 WepE 
786. 0.64 0. 88 Ship3 5 WepC 
720: 0. 76 1.08 Ship3 6 WepC 
63.1 0. 88 1. 28 Ship3 zi WepC 
431. 1. 00 1.10 Ship3 8 WepD 
457. 2 1.48 Ship3 2 WepC 
Sour 1. 24 1.44 Ship3 10 WepE 
DOE 1236 Lon Ship3 il dl WepF 
46. 1. 48 1.66 Sship3 12 WepF 
40. 160 Ls Gal Ship3 Ps WepF 
350 Lave i o0 Ship3 14 WepF 
28. 1.84 Zee ship3 ile WepF 
24. 36 2526 Ship3 16 WepF 
ZO: 2208 2a Ship3 alii WepF 
sy. 2.20 2.56 Ship3 18 WepF 
LO; 2s oe 2H Al Ship3 19 WepF 
ae 2.44 2266 Ship3 20 WepF 
Is NL(4) Number of lifts requested by receiver 4 
1064. Oa 0226 ship4 1 WepC 
LOZ 0. 28 0.56 Ship4 2 WepC 
934. 0.40 0.50 Ship4 3 WepD 
626: 0.352 0.72 Ship4 4 WepE 
780. 0.64 0. 84 Ship4 5 WepC 
661. 0.76 1.04 Ship4 6 WepC 
52s: 0. 88 aL Oke: Ship4 7 WepE 
64. 1 10k, Las Ship4 8 WepG 
Sor es 72 1.30 Ship4 2 WepG 
Bie, eee 1.45 Ship4 10 WepG 
31. 1. 36 ihe (a0) Ship4 Bt WepG 
oS. 1. 48 la Ship4 2 WepG 
di 1. 60 1736 Ship4 is WepG 
CV( j,k) X( j,k) C(j,k) ShipJ K 
Marg. Transfer Strike- Reva. Lift Weapon 
Combat comp.time down No. 
Value comp. time 


PANS) 


APPENDIX F. DIFFUSION APPROXIMATION DIRECT 
STEADY-STATE SOLUTION 


When the service discipline is probabilistic-longest-line, the diffusion approximation 
ordinary differential equations can be used to get a steady-state solution directly by set- 
ting the derivatives to zero; see Morrison, Gaver, and Pilnick [Ref. 42]. 

The method used to compute the steady-state mean involves setting the rate of 
change in the deterministic differential equations to zero, summing over all item types, 
using Newton's method to find the fixed point for the denominator of the q¢,(m(r)) terms, 


then backsolving for each steady-state m(r) as follows: 


From Equation (5.37) 


drm, _ 
a = 4; (a; — m,(2)) — wm); 





fori=1,...,/. Setting the derivative to zero gives the steady-state condition 
A; (a; — mfoo)) = u;g{m(co)) ; 


for i=I,..., J. Using the PLL;1 service discipline, this becomes 


A; (a, i moo) = 


for’ = 1,..., /. Letting 


and solving for moo) gives 
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rn. 


Ve 


A 2}, 0; 


(F.1) 


fori=1,...,/. Multiplying both sides by w;/u; gives 


Wi A A; a; Wi 
ues) Sa —————— 
Hj : A A; | Ww; Va | 


for ;=1,..., 7. Summing over all i, the left hand side is then equal to A, which cancels 


giving 


» anti en (ea) 
utd A; + w;) am 


i 


This expression is a function of only one variable, A, which may then be solved numer- 
ically bv, for example, Newton’s Method. The solution for A may then be used in (F.1) 
10 SolveqGrmles))7 — [yee 


In the special case of unit weights and equal arrival rates for all items, a very long 


derivation obtains the following expression for the steady-state covariances, and hence, 


queue length variances: 


~~ 204 +1) 


(oo) m{oo) B (co) 6? moo) b? 
we 4 | | E ) moo) B Ami i Antes) 4g 


A(2AA +b) 


for all 7 andj, where 


A=) [mfoo)lu) , 


J 


B=) [blu , 
y 


and 


b? = /,[a;— m,(co)] + [11,(00)/A] . 
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Using his generating function approach for the steady-state under the same circum- 
stances, Morrison gets the following solution for the covariances which more closely 


match the simulation results: 


m{co) m(co) 


Ne eee UM, ee 
1S) = Tey rempyoy eam aye a +24/A+1)-A(— + )| + 


Hi ,A+ 1] 


for all i andj, where 


A=) [mfoo)/u] , 
t] 


and 


Ce dam (c0)/u] 
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